diff options
| -rw-r--r-- | .gitignore | 1 | ||||
| -rw-r--r-- | python-metaphor-connectors.spec | 333 | ||||
| -rw-r--r-- | sources | 1 |
3 files changed, 335 insertions, 0 deletions
@@ -0,0 +1 @@ +/metaphor_connectors-0.11.129.tar.gz diff --git a/python-metaphor-connectors.spec b/python-metaphor-connectors.spec new file mode 100644 index 0000000..cb5f525 --- /dev/null +++ b/python-metaphor-connectors.spec @@ -0,0 +1,333 @@ +%global _empty_manifest_terminate_build 0 +Name: python-metaphor-connectors +Version: 0.11.129 +Release: 1 +Summary: A collection of Python-based 'connectors' that extract metadata from various sources to ingest into the Metaphor app. +License: Apache-2.0 +URL: https://metaphor.io +Source0: https://mirrors.nju.edu.cn/pypi/web/packages/0b/a0/ac7d1903b28585ddd6d5d6db131f642fdad09ed10128fdf2451fd20a9d4e/metaphor_connectors-0.11.129.tar.gz +BuildArch: noarch + +Requires: python3-asyncpg +Requires: python3-aws-assume-role-lib +Requires: python3-boto3 +Requires: python3-botocore +Requires: python3-canonicaljson +Requires: python3-databricks-cli +Requires: python3-fastjsonschema +Requires: python3-GitPython +Requires: python3-google-cloud-bigquery +Requires: python3-google-cloud-logging +Requires: python3-lkml +Requires: python3-looker-sdk +Requires: python3-metaphor-models +Requires: python3-metaphor-sqllineage +Requires: python3-msal +Requires: python3-pydantic +Requires: python3-pymssql +Requires: python3-pymysql +Requires: python3-dateutil +Requires: python3-PyYAML +Requires: python3-requests +Requires: python3-smart-open +Requires: python3-snowflake-connector-python +Requires: python3-SQLAlchemy +Requires: python3-sql-metadata +Requires: python3-tableauserverclient +Requires: python3-thoughtspot-rest-api-sdk + +%description +<a href="https://metaphor.io"><img src="https://github.com/MetaphorData/connectors/raw/main/logo.png" width="300" /></a> + +# Metaphor Connectors + +[](https://coveralls.io/github/MetaphorData/connectors?branch=main) +[](https://github.com/MetaphorData/connectors/actions/workflows/codeql-analysis.yml) +[](https://pypi.org/project/metaphor-connectors/) + + +[](https://github.com/MetaphorData/connectors/blob/master/LICENSE) + +This repository contains a collection of Python-based "connectors" that extract metadata from various sources to ingest into the [Metaphor](https://metaphor.io) platform. + +## Installation + +This package requires Python 3.7+ installed. You can verify the version on your system by running the following command, + +```shell +python -V # or python3 on some systems +``` + +Once verified, you can install the package using [pip](https://docs.python.org/3/installing/index.html), + +```shell +pip install "metaphor-connectors[all]" # or pip3 on some systems +``` + +This will install all the connectors and required dependencies. You can also choose to install only a subset of the dependencies by installing the specific [extra](https://packaging.python.org/tutorials/installing-packages/#installing-setuptools-extras), e.g. + +```shell +pip install "metaphor-connectors[snowflake]" +``` + +Similarly, you can also install the package using `requirements.txt` or `pyproject.toml`. + +## Connectors + +Each connector is placed under its own directory under [metaphor](./metaphor) and extends the `metaphor.common.BaseExtractor` class. + +| Connector Name | Metadata | +|---------------------------------------------------------------|------------------------------------------| +| [airflow_plugin](metaphor/airflow_plugin/README.md) | Lineage | +| [bigquery](metaphor/bigquery/README.md) | Schema, description, statistics, queries | +| [bigquery.lineage](metaphor/bigquery/lineage/README.md) | Lineage | +| [bigquery.profile](metaphor/bigquery/profile/README.md) | Data profile | +| [dbt](metaphor/dbt/README.md) | dbt model, test, lineage | +| [dbt.cloud](metaphor/dbt/cloud/README.md) | dbt model, test, lineage | +| [glue](metaphor/glue/README.md) | Schema, description | +| [looker](metaphor/looker/README.md) | Looker view, explore, dashboard, lineage | +| [manual.data_quality](metaphor/manual/data_quality/README.md) | Data quality | +| [manual.governance](metaphor/manual/governance/README.md) | Ownership, tags, description | +| [manual.lineage](metaphor/manual/lineage/README.md) | Lineage | +| [manual.metadata](metaphor/manual/metadata/README.md) | Custom metadata | +| [metabase](metaphor/metabase/README.md) | Dashboard, lineage | +| [mssql](metaphor/mssql/README.md) | Schema | +| [mysql](metaphor/mysql/README.md) | Schema, description | +| [postgresql](metaphor/postgresql/README.md) | Schema, description, statistics | +| [postgresql.profile](metaphor/postgresql/profile/README.md) | Data profile | +| [postgresql.usage](metaphor/postgresql/usage/README.md) | Usage | +| [power_bi](metaphor/power_bi/README.md) | Dashboard, lineage | +| [redshift](metaphor/redshift/README.md) | Schema, description, statistics, queries | +| [redshift.lineage](metaphor/redshift/lineage/README.md) | Lineage | +| [redshift.profile](metaphor/redshift/profile/README.md) | Data profile | +| [snowflake](metaphor/snowflake/README.md) | Schema, description, statistics, queries | +| [snowflake.lineage](metaphor/snowflake/lineage/README.md) | Lineage | +| [snowflake.profile](metaphor/snowflake/profile/README.md) | Data profile | +| [synapse](metaphor/synapse//README.md) | Schema, queries | +| [tableau](metaphor/tableau/README.md) | Dashboard, lineage | +| [thought_spot](metaphor/thought_spot/README.md) | Dashboard, lineage | +| [unity_catalog](metaphor/unity_catalog/README.md) | Schema, description | + +## Development + +See [Development Environment](docs/develop.md) for more instructions on how to setup your local development environment. + +## Custom Connectors + +See [Adding a Custom Connector](docs/custom.md) for instructions and a full example on how to create your custom connectors. + + +%package -n python3-metaphor-connectors +Summary: A collection of Python-based 'connectors' that extract metadata from various sources to ingest into the Metaphor app. +Provides: python-metaphor-connectors +BuildRequires: python3-devel +BuildRequires: python3-setuptools +BuildRequires: python3-pip +%description -n python3-metaphor-connectors +<a href="https://metaphor.io"><img src="https://github.com/MetaphorData/connectors/raw/main/logo.png" width="300" /></a> + +# Metaphor Connectors + +[](https://coveralls.io/github/MetaphorData/connectors?branch=main) +[](https://github.com/MetaphorData/connectors/actions/workflows/codeql-analysis.yml) +[](https://pypi.org/project/metaphor-connectors/) + + +[](https://github.com/MetaphorData/connectors/blob/master/LICENSE) + +This repository contains a collection of Python-based "connectors" that extract metadata from various sources to ingest into the [Metaphor](https://metaphor.io) platform. + +## Installation + +This package requires Python 3.7+ installed. You can verify the version on your system by running the following command, + +```shell +python -V # or python3 on some systems +``` + +Once verified, you can install the package using [pip](https://docs.python.org/3/installing/index.html), + +```shell +pip install "metaphor-connectors[all]" # or pip3 on some systems +``` + +This will install all the connectors and required dependencies. You can also choose to install only a subset of the dependencies by installing the specific [extra](https://packaging.python.org/tutorials/installing-packages/#installing-setuptools-extras), e.g. + +```shell +pip install "metaphor-connectors[snowflake]" +``` + +Similarly, you can also install the package using `requirements.txt` or `pyproject.toml`. + +## Connectors + +Each connector is placed under its own directory under [metaphor](./metaphor) and extends the `metaphor.common.BaseExtractor` class. + +| Connector Name | Metadata | +|---------------------------------------------------------------|------------------------------------------| +| [airflow_plugin](metaphor/airflow_plugin/README.md) | Lineage | +| [bigquery](metaphor/bigquery/README.md) | Schema, description, statistics, queries | +| [bigquery.lineage](metaphor/bigquery/lineage/README.md) | Lineage | +| [bigquery.profile](metaphor/bigquery/profile/README.md) | Data profile | +| [dbt](metaphor/dbt/README.md) | dbt model, test, lineage | +| [dbt.cloud](metaphor/dbt/cloud/README.md) | dbt model, test, lineage | +| [glue](metaphor/glue/README.md) | Schema, description | +| [looker](metaphor/looker/README.md) | Looker view, explore, dashboard, lineage | +| [manual.data_quality](metaphor/manual/data_quality/README.md) | Data quality | +| [manual.governance](metaphor/manual/governance/README.md) | Ownership, tags, description | +| [manual.lineage](metaphor/manual/lineage/README.md) | Lineage | +| [manual.metadata](metaphor/manual/metadata/README.md) | Custom metadata | +| [metabase](metaphor/metabase/README.md) | Dashboard, lineage | +| [mssql](metaphor/mssql/README.md) | Schema | +| [mysql](metaphor/mysql/README.md) | Schema, description | +| [postgresql](metaphor/postgresql/README.md) | Schema, description, statistics | +| [postgresql.profile](metaphor/postgresql/profile/README.md) | Data profile | +| [postgresql.usage](metaphor/postgresql/usage/README.md) | Usage | +| [power_bi](metaphor/power_bi/README.md) | Dashboard, lineage | +| [redshift](metaphor/redshift/README.md) | Schema, description, statistics, queries | +| [redshift.lineage](metaphor/redshift/lineage/README.md) | Lineage | +| [redshift.profile](metaphor/redshift/profile/README.md) | Data profile | +| [snowflake](metaphor/snowflake/README.md) | Schema, description, statistics, queries | +| [snowflake.lineage](metaphor/snowflake/lineage/README.md) | Lineage | +| [snowflake.profile](metaphor/snowflake/profile/README.md) | Data profile | +| [synapse](metaphor/synapse//README.md) | Schema, queries | +| [tableau](metaphor/tableau/README.md) | Dashboard, lineage | +| [thought_spot](metaphor/thought_spot/README.md) | Dashboard, lineage | +| [unity_catalog](metaphor/unity_catalog/README.md) | Schema, description | + +## Development + +See [Development Environment](docs/develop.md) for more instructions on how to setup your local development environment. + +## Custom Connectors + +See [Adding a Custom Connector](docs/custom.md) for instructions and a full example on how to create your custom connectors. + + +%package help +Summary: Development documents and examples for metaphor-connectors +Provides: python3-metaphor-connectors-doc +%description help +<a href="https://metaphor.io"><img src="https://github.com/MetaphorData/connectors/raw/main/logo.png" width="300" /></a> + +# Metaphor Connectors + +[](https://coveralls.io/github/MetaphorData/connectors?branch=main) +[](https://github.com/MetaphorData/connectors/actions/workflows/codeql-analysis.yml) +[](https://pypi.org/project/metaphor-connectors/) + + +[](https://github.com/MetaphorData/connectors/blob/master/LICENSE) + +This repository contains a collection of Python-based "connectors" that extract metadata from various sources to ingest into the [Metaphor](https://metaphor.io) platform. + +## Installation + +This package requires Python 3.7+ installed. You can verify the version on your system by running the following command, + +```shell +python -V # or python3 on some systems +``` + +Once verified, you can install the package using [pip](https://docs.python.org/3/installing/index.html), + +```shell +pip install "metaphor-connectors[all]" # or pip3 on some systems +``` + +This will install all the connectors and required dependencies. You can also choose to install only a subset of the dependencies by installing the specific [extra](https://packaging.python.org/tutorials/installing-packages/#installing-setuptools-extras), e.g. + +```shell +pip install "metaphor-connectors[snowflake]" +``` + +Similarly, you can also install the package using `requirements.txt` or `pyproject.toml`. + +## Connectors + +Each connector is placed under its own directory under [metaphor](./metaphor) and extends the `metaphor.common.BaseExtractor` class. + +| Connector Name | Metadata | +|---------------------------------------------------------------|------------------------------------------| +| [airflow_plugin](metaphor/airflow_plugin/README.md) | Lineage | +| [bigquery](metaphor/bigquery/README.md) | Schema, description, statistics, queries | +| [bigquery.lineage](metaphor/bigquery/lineage/README.md) | Lineage | +| [bigquery.profile](metaphor/bigquery/profile/README.md) | Data profile | +| [dbt](metaphor/dbt/README.md) | dbt model, test, lineage | +| [dbt.cloud](metaphor/dbt/cloud/README.md) | dbt model, test, lineage | +| [glue](metaphor/glue/README.md) | Schema, description | +| [looker](metaphor/looker/README.md) | Looker view, explore, dashboard, lineage | +| [manual.data_quality](metaphor/manual/data_quality/README.md) | Data quality | +| [manual.governance](metaphor/manual/governance/README.md) | Ownership, tags, description | +| [manual.lineage](metaphor/manual/lineage/README.md) | Lineage | +| [manual.metadata](metaphor/manual/metadata/README.md) | Custom metadata | +| [metabase](metaphor/metabase/README.md) | Dashboard, lineage | +| [mssql](metaphor/mssql/README.md) | Schema | +| [mysql](metaphor/mysql/README.md) | Schema, description | +| [postgresql](metaphor/postgresql/README.md) | Schema, description, statistics | +| [postgresql.profile](metaphor/postgresql/profile/README.md) | Data profile | +| [postgresql.usage](metaphor/postgresql/usage/README.md) | Usage | +| [power_bi](metaphor/power_bi/README.md) | Dashboard, lineage | +| [redshift](metaphor/redshift/README.md) | Schema, description, statistics, queries | +| [redshift.lineage](metaphor/redshift/lineage/README.md) | Lineage | +| [redshift.profile](metaphor/redshift/profile/README.md) | Data profile | +| [snowflake](metaphor/snowflake/README.md) | Schema, description, statistics, queries | +| [snowflake.lineage](metaphor/snowflake/lineage/README.md) | Lineage | +| [snowflake.profile](metaphor/snowflake/profile/README.md) | Data profile | +| [synapse](metaphor/synapse//README.md) | Schema, queries | +| [tableau](metaphor/tableau/README.md) | Dashboard, lineage | +| [thought_spot](metaphor/thought_spot/README.md) | Dashboard, lineage | +| [unity_catalog](metaphor/unity_catalog/README.md) | Schema, description | + +## Development + +See [Development Environment](docs/develop.md) for more instructions on how to setup your local development environment. + +## Custom Connectors + +See [Adding a Custom Connector](docs/custom.md) for instructions and a full example on how to create your custom connectors. + + +%prep +%autosetup -n metaphor-connectors-0.11.129 + +%build +%py3_build + +%install +%py3_install +install -d -m755 %{buildroot}/%{_pkgdocdir} +if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi +if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi +if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi +if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi +pushd %{buildroot} +if [ -d usr/lib ]; then + find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/lib64 ]; then + find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/bin ]; then + find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/sbin ]; then + find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst +fi +touch doclist.lst +if [ -d usr/share/man ]; then + find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst +fi +popd +mv %{buildroot}/filelist.lst . +mv %{buildroot}/doclist.lst . + +%files -n python3-metaphor-connectors -f filelist.lst +%dir %{python3_sitelib}/* + +%files help -f doclist.lst +%{_docdir}/* + +%changelog +* Tue Apr 11 2023 Python_Bot <Python_Bot@openeuler.org> - 0.11.129-1 +- Package Spec generated @@ -0,0 +1 @@ +7ddce52d3dc732997850fa3be0ff3d7c metaphor_connectors-0.11.129.tar.gz |