%global _empty_manifest_terminate_build 0 Name: python-data-lineage Version: 0.9.0 Release: 1 Summary: Open Source Data Lineage Tool for Redshift. Snowflake and many other databases License: MIT URL: https://tokern.io/ Source0: https://mirrors.aliyun.com/pypi/web/packages/7c/03/68282a2ecfbff10d97d7b6141a3cc3f436c3f115a4eaa1d59f862c3bb207/data-lineage-0.9.0.tar.gz BuildArch: noarch Requires: python3-pglast Requires: python3-inflection Requires: python3-networkx Requires: python3-click Requires: python3-PyYAML Requires: python3-dbcat Requires: python3-gunicorn Requires: python3-flask Requires: python3-flask-restless-ng Requires: python3-requests Requires: python3-furl Requires: python3-flask-restful Requires: python3-psycopg2 Requires: python3-SQLAlchemy Requires: python3-botocore Requires: python3-rq Requires: python3-redis %description # Tokern Lineage Engine [![CircleCI](https://circleci.com/gh/tokern/data-lineage.svg?style=svg)](https://circleci.com/gh/tokern/data-lineage) [![codecov](https://codecov.io/gh/tokern/data-lineage/branch/master/graph/badge.svg)](https://codecov.io/gh/tokern/data-lineage) [![PyPI](https://img.shields.io/pypi/v/data-lineage.svg)](https://pypi.python.org/pypi/data-lineage) [![image](https://img.shields.io/pypi/l/data-lineage.svg)](https://pypi.org/project/data-lineage/) [![image](https://img.shields.io/pypi/pyversions/data-lineage.svg)](https://pypi.org/project/data-lineage/) Tokern Lineage Engine is _fast_ and _easy to use_ application to collect, visualize and analyze column-level data lineage in databases, data warehouses and data lakes in AWS and GCP. Tokern Lineage helps you browse column-level data lineage * visually using [kedro-viz](https://github.com/quantumblacklabs/kedro-viz) * analyze lineage graphs programmatically using the powerful [networkx graph library](https://networkx.org/) ## Resources * Demo of Tokern Lineage App ![data-lineage](https://user-images.githubusercontent.com/1638298/118261607-688a7100-b4d1-11eb-923a-5d2407d6bd8d.gif) * Checkout an [example data lineage notebook](http://tokern.io/docs/data-lineage/example/). * Check out [the post on using data lineage for cost control](https://tokern.io/blog/data-lineage-on-redshift/) for an example of how data lineage can be used in production. ## Quick Start ### Install a demo of using Docker and Docker Compose Download the docker-compose file from Github repository. # in a new directory run wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml # or run curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml -o docker-compose.yml Run docker-compose docker-compose up -d Check that the containers are running. docker ps CONTAINER ID IMAGE CREATED STATUS PORTS NAMES 3f4e77845b81 tokern/data-lineage-viz:latest ... 4 hours ago Up 4 hours 0.0.0.0:8000->80/tcp tokern-data-lineage-visualizer 1e1ce4efd792 tokern/data-lineage:latest ... 5 days ago Up 5 days tokern-data-lineage 38be15bedd39 tokern/demodb:latest ... 2 weeks ago Up 2 weeks tokern-demodb Try out Tokern Lineage App Head to `http://localhost:8000/` to open the Tokern Lineage app ### Install Tokern Lineage Engine # in a new directory run wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml # or run curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml -o tokern-lineage-engine.yml Run docker-compose docker-compose up -d If you want to use an external Postgres database, change the following parameters in `tokern-lineage-engine.yml`: * CATALOG_HOST * CATALOG_USER * CATALOG_PASSWORD * CATALOG_DB You can also override default values using environement variables. CATALOG_HOST=... CATALOG_USER=... CATALOG_PASSWORD=... CATALOG_DB=... docker-compose -f ... up -d For more advanced usage of environment variables with docker-compose, [refer to docker-compose docs](https://docs.docker.com/compose/environment-variables/) **Pro-tip** If you want to connect to a database in the host machine, set CATALOG_HOST: host.docker.internal # For mac or windows #OR CATALOG_HOST: 172.17.0.1 # Linux ## Supported Technologies * Postgres * AWS Redshift * Snowflake ### Coming Soon * SparkSQL * Presto ## Documentation For advanced usage, please refer to [data-lineage documentation](https://tokern.io/docs/data-lineage/index.html) ## Survey Please take this [survey](https://forms.gle/p2oEQBJnpEguhrp3A) if you are a user or considering using data-lineage. Responses will help us prioritize features better. %package -n python3-data-lineage Summary: Open Source Data Lineage Tool for Redshift. Snowflake and many other databases Provides: python-data-lineage BuildRequires: python3-devel BuildRequires: python3-setuptools BuildRequires: python3-pip %description -n python3-data-lineage # Tokern Lineage Engine [![CircleCI](https://circleci.com/gh/tokern/data-lineage.svg?style=svg)](https://circleci.com/gh/tokern/data-lineage) [![codecov](https://codecov.io/gh/tokern/data-lineage/branch/master/graph/badge.svg)](https://codecov.io/gh/tokern/data-lineage) [![PyPI](https://img.shields.io/pypi/v/data-lineage.svg)](https://pypi.python.org/pypi/data-lineage) [![image](https://img.shields.io/pypi/l/data-lineage.svg)](https://pypi.org/project/data-lineage/) [![image](https://img.shields.io/pypi/pyversions/data-lineage.svg)](https://pypi.org/project/data-lineage/) Tokern Lineage Engine is _fast_ and _easy to use_ application to collect, visualize and analyze column-level data lineage in databases, data warehouses and data lakes in AWS and GCP. Tokern Lineage helps you browse column-level data lineage * visually using [kedro-viz](https://github.com/quantumblacklabs/kedro-viz) * analyze lineage graphs programmatically using the powerful [networkx graph library](https://networkx.org/) ## Resources * Demo of Tokern Lineage App ![data-lineage](https://user-images.githubusercontent.com/1638298/118261607-688a7100-b4d1-11eb-923a-5d2407d6bd8d.gif) * Checkout an [example data lineage notebook](http://tokern.io/docs/data-lineage/example/). * Check out [the post on using data lineage for cost control](https://tokern.io/blog/data-lineage-on-redshift/) for an example of how data lineage can be used in production. ## Quick Start ### Install a demo of using Docker and Docker Compose Download the docker-compose file from Github repository. # in a new directory run wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml # or run curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml -o docker-compose.yml Run docker-compose docker-compose up -d Check that the containers are running. docker ps CONTAINER ID IMAGE CREATED STATUS PORTS NAMES 3f4e77845b81 tokern/data-lineage-viz:latest ... 4 hours ago Up 4 hours 0.0.0.0:8000->80/tcp tokern-data-lineage-visualizer 1e1ce4efd792 tokern/data-lineage:latest ... 5 days ago Up 5 days tokern-data-lineage 38be15bedd39 tokern/demodb:latest ... 2 weeks ago Up 2 weeks tokern-demodb Try out Tokern Lineage App Head to `http://localhost:8000/` to open the Tokern Lineage app ### Install Tokern Lineage Engine # in a new directory run wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml # or run curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml -o tokern-lineage-engine.yml Run docker-compose docker-compose up -d If you want to use an external Postgres database, change the following parameters in `tokern-lineage-engine.yml`: * CATALOG_HOST * CATALOG_USER * CATALOG_PASSWORD * CATALOG_DB You can also override default values using environement variables. CATALOG_HOST=... CATALOG_USER=... CATALOG_PASSWORD=... CATALOG_DB=... docker-compose -f ... up -d For more advanced usage of environment variables with docker-compose, [refer to docker-compose docs](https://docs.docker.com/compose/environment-variables/) **Pro-tip** If you want to connect to a database in the host machine, set CATALOG_HOST: host.docker.internal # For mac or windows #OR CATALOG_HOST: 172.17.0.1 # Linux ## Supported Technologies * Postgres * AWS Redshift * Snowflake ### Coming Soon * SparkSQL * Presto ## Documentation For advanced usage, please refer to [data-lineage documentation](https://tokern.io/docs/data-lineage/index.html) ## Survey Please take this [survey](https://forms.gle/p2oEQBJnpEguhrp3A) if you are a user or considering using data-lineage. Responses will help us prioritize features better. %package help Summary: Development documents and examples for data-lineage Provides: python3-data-lineage-doc %description help # Tokern Lineage Engine [![CircleCI](https://circleci.com/gh/tokern/data-lineage.svg?style=svg)](https://circleci.com/gh/tokern/data-lineage) [![codecov](https://codecov.io/gh/tokern/data-lineage/branch/master/graph/badge.svg)](https://codecov.io/gh/tokern/data-lineage) [![PyPI](https://img.shields.io/pypi/v/data-lineage.svg)](https://pypi.python.org/pypi/data-lineage) [![image](https://img.shields.io/pypi/l/data-lineage.svg)](https://pypi.org/project/data-lineage/) [![image](https://img.shields.io/pypi/pyversions/data-lineage.svg)](https://pypi.org/project/data-lineage/) Tokern Lineage Engine is _fast_ and _easy to use_ application to collect, visualize and analyze column-level data lineage in databases, data warehouses and data lakes in AWS and GCP. Tokern Lineage helps you browse column-level data lineage * visually using [kedro-viz](https://github.com/quantumblacklabs/kedro-viz) * analyze lineage graphs programmatically using the powerful [networkx graph library](https://networkx.org/) ## Resources * Demo of Tokern Lineage App ![data-lineage](https://user-images.githubusercontent.com/1638298/118261607-688a7100-b4d1-11eb-923a-5d2407d6bd8d.gif) * Checkout an [example data lineage notebook](http://tokern.io/docs/data-lineage/example/). * Check out [the post on using data lineage for cost control](https://tokern.io/blog/data-lineage-on-redshift/) for an example of how data lineage can be used in production. ## Quick Start ### Install a demo of using Docker and Docker Compose Download the docker-compose file from Github repository. # in a new directory run wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml # or run curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml -o docker-compose.yml Run docker-compose docker-compose up -d Check that the containers are running. docker ps CONTAINER ID IMAGE CREATED STATUS PORTS NAMES 3f4e77845b81 tokern/data-lineage-viz:latest ... 4 hours ago Up 4 hours 0.0.0.0:8000->80/tcp tokern-data-lineage-visualizer 1e1ce4efd792 tokern/data-lineage:latest ... 5 days ago Up 5 days tokern-data-lineage 38be15bedd39 tokern/demodb:latest ... 2 weeks ago Up 2 weeks tokern-demodb Try out Tokern Lineage App Head to `http://localhost:8000/` to open the Tokern Lineage app ### Install Tokern Lineage Engine # in a new directory run wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/tokern-lineage-engine.yml # or run curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose/catalog-demo.yml -o tokern-lineage-engine.yml Run docker-compose docker-compose up -d If you want to use an external Postgres database, change the following parameters in `tokern-lineage-engine.yml`: * CATALOG_HOST * CATALOG_USER * CATALOG_PASSWORD * CATALOG_DB You can also override default values using environement variables. CATALOG_HOST=... CATALOG_USER=... CATALOG_PASSWORD=... CATALOG_DB=... docker-compose -f ... up -d For more advanced usage of environment variables with docker-compose, [refer to docker-compose docs](https://docs.docker.com/compose/environment-variables/) **Pro-tip** If you want to connect to a database in the host machine, set CATALOG_HOST: host.docker.internal # For mac or windows #OR CATALOG_HOST: 172.17.0.1 # Linux ## Supported Technologies * Postgres * AWS Redshift * Snowflake ### Coming Soon * SparkSQL * Presto ## Documentation For advanced usage, please refer to [data-lineage documentation](https://tokern.io/docs/data-lineage/index.html) ## Survey Please take this [survey](https://forms.gle/p2oEQBJnpEguhrp3A) if you are a user or considering using data-lineage. Responses will help us prioritize features better. %prep %autosetup -n data-lineage-0.9.0 %build %py3_build %install %py3_install install -d -m755 %{buildroot}/%{_pkgdocdir} if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi pushd %{buildroot} if [ -d usr/lib ]; then find usr/lib -type f -printf "\"/%h/%f\"\n" >> filelist.lst fi if [ -d usr/lib64 ]; then find usr/lib64 -type f -printf "\"/%h/%f\"\n" >> filelist.lst fi if [ -d usr/bin ]; then find usr/bin -type f -printf "\"/%h/%f\"\n" >> filelist.lst fi if [ -d usr/sbin ]; then find usr/sbin -type f -printf "\"/%h/%f\"\n" >> filelist.lst fi touch doclist.lst if [ -d usr/share/man ]; then find usr/share/man -type f -printf "\"/%h/%f.gz\"\n" >> doclist.lst fi popd mv %{buildroot}/filelist.lst . mv %{buildroot}/doclist.lst . %files -n python3-data-lineage -f filelist.lst %dir %{python3_sitelib}/* %files help -f doclist.lst %{_docdir}/* %changelog * Thu Jun 08 2023 Python_Bot - 0.9.0-1 - Package Spec generated