diff options
| author | CoprDistGit <infra@openeuler.org> | 2023-04-21 11:06:33 +0000 |
|---|---|---|
| committer | CoprDistGit <infra@openeuler.org> | 2023-04-21 11:06:33 +0000 |
| commit | 032723cd1baf442c8ea65151b1539ff27dec5e14 (patch) | |
| tree | 199fd128522da9dd832c30b9eb7b08f784655a89 | |
| parent | 1b3fcfd570bf3a2d1104839034a4e0a1084c3a70 (diff) | |
automatic import of python-awswrangleropeneuler20.03
| -rw-r--r-- | .gitignore | 1 | ||||
| -rw-r--r-- | python-awswrangler.spec | 329 | ||||
| -rw-r--r-- | sources | 2 |
3 files changed, 193 insertions, 139 deletions
@@ -1 +1,2 @@ /awswrangler-2.20.1.tar.gz +/awswrangler-3.0.0.tar.gz diff --git a/python-awswrangler.spec b/python-awswrangler.spec index ea30698..1b94955 100644 --- a/python-awswrangler.spec +++ b/python-awswrangler.spec @@ -1,33 +1,35 @@ %global _empty_manifest_terminate_build 0 Name: python-awswrangler -Version: 2.20.1 +Version: 3.0.0 Release: 1 Summary: Pandas on AWS. License: Apache-2.0 URL: https://aws-sdk-pandas.readthedocs.io/ -Source0: https://mirrors.nju.edu.cn/pypi/web/packages/8b/72/f76290dffdf1a991277702d584dbfd913c1ddb0c4787b1d9e76890da8125/awswrangler-2.20.1.tar.gz +Source0: https://mirrors.nju.edu.cn/pypi/web/packages/56/ae/43add1a275d7c4f149fa005239b34382e0f9b5a5deef164eb096346b4c46/awswrangler-3.0.0.tar.gz BuildArch: noarch Requires: python3-boto3 Requires: python3-botocore Requires: python3-pandas Requires: python3-numpy -Requires: python3-numpy Requires: python3-pyarrow +Requires: python3-typing-extensions Requires: python3-redshift-connector Requires: python3-pymysql Requires: python3-pg8000 -Requires: python3-openpyxl +Requires: python3-pyodbc +Requires: python3-oracledb +Requires: python3-gremlinpython +Requires: python3-SPARQLWrapper +Requires: python3-requests +Requires: python3-opensearch-py Requires: python3-requests-aws4auth Requires: python3-jsonpath-ng +Requires: python3-openpyxl Requires: python3-progressbar2 -Requires: python3-opensearch-py -Requires: python3-gremlinpython -Requires: python3-backoff -Requires: python3-SPARQLWrapper -Requires: python3-pyodbc -Requires: python3-oracledb Requires: python3-deltalake +Requires: python3-modin +Requires: python3-ray[data,default] %description # AWS SDK for pandas (awswrangler) @@ -43,13 +45,12 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q > An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | aws-proserve-opensource@amazon.com -[](https://pypi.org/project/awswrangler/) -[](https://anaconda.org/conda-forge/awswrangler) +[](https://pypi.org/project/awswrangler/) +[](https://anaconda.org/conda-forge/awswrangler) [](https://github.com/psf/black) [](https://opensource.org/licenses/Apache-2.0) [](http://mypy-lang.org/) -[](https://pypi.org/project/awswrangler/)  [](https://aws-sdk-pandas.readthedocs.io/?badge=latest) @@ -58,14 +59,15 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q | **[PyPi](https://pypi.org/project/awswrangler/)** | [](https://pypi.org/project/awswrangler/) | `pip install awswrangler` | | **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` | -> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br> -➡️ `pip install pyarrow==2 awswrangler` +> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br> +➡️`pip install 'awswrangler[redshift]'` Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/) ## Table of contents - [Quick Start](#quick-start) +- [At Scale](#at-scale) - [Read The Docs](#read-the-docs) - [Getting Help](#getting-help) - [Community Resources](#community-resources) @@ -76,8 +78,8 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http Installation command: `pip install awswrangler` -> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br> -➡️`pip install pyarrow==2 awswrangler` +> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br> +➡️`pip install 'awswrangler[redshift]'` ```py3 import awswrangler as wr @@ -128,19 +130,28 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3 ``` +## At scale +AWS SDK for pandas can also run your workflows at scale by leveraging [Modin](https://modin.readthedocs.io/en/stable/) and [Ray](https://www.ray.io/). Both projects aim to speed up data workloads by distributing processing over a cluster of workers. + +The quickest way to get started is to use AWS Glue with Ray. Read our [docs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html), our [blog](https://aws.amazon.com/blogs/big-data/scale-aws-sdk-for-pandas-workloads-with-aws-glue-for-ray/), or head to our latest [tutorials](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) to discover even more features. + ## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/) -- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/about.html) -- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html) - - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#pypi-pip) - - [Conda](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#conda) - - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-lambda-layer) - - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-python-shell-jobs) - - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs) - - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook) - - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook-lifecycle) - - [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr) - - [From source](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#from-source) +- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/what.html) +- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html) + - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#pypi-pip) + - [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#conda) + - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-lambda-layer) + - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-python-shell-jobs) + - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-pyspark-jobs) + - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook) + - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook-lifecycle) + - [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#emr) + - [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#from-source) +- [**At scale**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html) + - [Getting Started](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#getting-started) + - [Supported APIs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#supported-apis) + - [Resources](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#resources) - [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) - [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb) - [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb) @@ -175,30 +186,37 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3 - [031 - OpenSearch](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/031%20-%20OpenSearch.ipynb) - [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb) - [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb) - - [034 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-Glue%20%20Data%20Quality.ipynb) -- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html) - - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-s3) - - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-glue-catalog) - - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-athena) - - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-lake-formation) - - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-redshift) - - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#postgresql) - - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#mysql) - - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#sqlserver) - - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#oracle) - - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-redshift) - - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-rds) - - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#opensearch) - - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-neptune) - - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#dynamodb) - - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-timestream) - - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-emr) - - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-cloudwatch-logs) - - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-chime) - - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-quicksight) - - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-sts) - - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-secrets-manager) - - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#global-configurations) + - [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb) + - [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb) + - [036 - Distributing Calls with Glue Interactive Sessions on Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/036%20-%20Distributing%20Calls%20with%20Glue%20Interactive%20Sessions%20on%20Ray.ipynb) + - [037 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/037%20-%20Glue%20Data%20Quality.ipynb) + - [038 - OpenSearch Serverless](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/038%20-%20OpenSearch%20Serverless.ipynb) + - [039 - Athena Iceberg](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/039%20-%20Athena%20Iceberg.ipynb) +- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html) + - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-s3) + - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-catalog) + - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-athena) + - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-lake-formation) + - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-redshift) + - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#postgresql) + - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#mysql) + - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#sqlserver) + - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#oracle) + - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-redshift) + - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-rds) + - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#opensearch) + - [AWS Glue Data Quality](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-data-quality) + - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-neptune) + - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#dynamodb) + - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-timestream) + - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-emr) + - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-cloudwatch-logs) + - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-chime) + - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-quicksight) + - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-sts) + - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-secrets-manager) + - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#global-configurations) + - [Distributed - Ray](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#distributed-ray) - [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt) - [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md) @@ -209,6 +227,7 @@ You may also find help on these community resources: * The #aws-sdk-pandas Slack [channel](https://join.slack.com/t/aws-sdk-pandas/shared_invite/zt-sxdx38sl-E0coRfAds8WdpxXD2Nzfrg) * Ask a question on [Stack Overflow](https://stackoverflow.com/questions/tagged/awswrangler) and tag it with `awswrangler` +* [Runbook](https://github.com/aws/aws-sdk-pandas/discussions/1815) for AWS SDK for pandas with Ray ## Community Resources @@ -293,13 +312,12 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q > An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | aws-proserve-opensource@amazon.com -[](https://pypi.org/project/awswrangler/) -[](https://anaconda.org/conda-forge/awswrangler) +[](https://pypi.org/project/awswrangler/) +[](https://anaconda.org/conda-forge/awswrangler) [](https://github.com/psf/black) [](https://opensource.org/licenses/Apache-2.0) [](http://mypy-lang.org/) -[](https://pypi.org/project/awswrangler/)  [](https://aws-sdk-pandas.readthedocs.io/?badge=latest) @@ -308,14 +326,15 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q | **[PyPi](https://pypi.org/project/awswrangler/)** | [](https://pypi.org/project/awswrangler/) | `pip install awswrangler` | | **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` | -> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br> -➡️ `pip install pyarrow==2 awswrangler` +> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br> +➡️`pip install 'awswrangler[redshift]'` Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/) ## Table of contents - [Quick Start](#quick-start) +- [At Scale](#at-scale) - [Read The Docs](#read-the-docs) - [Getting Help](#getting-help) - [Community Resources](#community-resources) @@ -326,8 +345,8 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http Installation command: `pip install awswrangler` -> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br> -➡️`pip install pyarrow==2 awswrangler` +> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br> +➡️`pip install 'awswrangler[redshift]'` ```py3 import awswrangler as wr @@ -378,19 +397,28 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3 ``` +## At scale +AWS SDK for pandas can also run your workflows at scale by leveraging [Modin](https://modin.readthedocs.io/en/stable/) and [Ray](https://www.ray.io/). Both projects aim to speed up data workloads by distributing processing over a cluster of workers. + +The quickest way to get started is to use AWS Glue with Ray. Read our [docs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html), our [blog](https://aws.amazon.com/blogs/big-data/scale-aws-sdk-for-pandas-workloads-with-aws-glue-for-ray/), or head to our latest [tutorials](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) to discover even more features. + ## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/) -- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/about.html) -- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html) - - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#pypi-pip) - - [Conda](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#conda) - - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-lambda-layer) - - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-python-shell-jobs) - - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs) - - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook) - - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook-lifecycle) - - [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr) - - [From source](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#from-source) +- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/what.html) +- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html) + - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#pypi-pip) + - [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#conda) + - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-lambda-layer) + - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-python-shell-jobs) + - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-pyspark-jobs) + - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook) + - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook-lifecycle) + - [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#emr) + - [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#from-source) +- [**At scale**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html) + - [Getting Started](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#getting-started) + - [Supported APIs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#supported-apis) + - [Resources](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#resources) - [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) - [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb) - [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb) @@ -425,30 +453,37 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3 - [031 - OpenSearch](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/031%20-%20OpenSearch.ipynb) - [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb) - [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb) - - [034 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-Glue%20%20Data%20Quality.ipynb) -- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html) - - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-s3) - - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-glue-catalog) - - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-athena) - - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-lake-formation) - - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-redshift) - - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#postgresql) - - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#mysql) - - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#sqlserver) - - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#oracle) - - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-redshift) - - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-rds) - - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#opensearch) - - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-neptune) - - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#dynamodb) - - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-timestream) - - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-emr) - - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-cloudwatch-logs) - - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-chime) - - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-quicksight) - - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-sts) - - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-secrets-manager) - - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#global-configurations) + - [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb) + - [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb) + - [036 - Distributing Calls with Glue Interactive Sessions on Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/036%20-%20Distributing%20Calls%20with%20Glue%20Interactive%20Sessions%20on%20Ray.ipynb) + - [037 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/037%20-%20Glue%20Data%20Quality.ipynb) + - [038 - OpenSearch Serverless](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/038%20-%20OpenSearch%20Serverless.ipynb) + - [039 - Athena Iceberg](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/039%20-%20Athena%20Iceberg.ipynb) +- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html) + - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-s3) + - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-catalog) + - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-athena) + - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-lake-formation) + - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-redshift) + - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#postgresql) + - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#mysql) + - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#sqlserver) + - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#oracle) + - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-redshift) + - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-rds) + - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#opensearch) + - [AWS Glue Data Quality](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-data-quality) + - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-neptune) + - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#dynamodb) + - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-timestream) + - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-emr) + - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-cloudwatch-logs) + - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-chime) + - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-quicksight) + - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-sts) + - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-secrets-manager) + - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#global-configurations) + - [Distributed - Ray](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#distributed-ray) - [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt) - [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md) @@ -459,6 +494,7 @@ You may also find help on these community resources: * The #aws-sdk-pandas Slack [channel](https://join.slack.com/t/aws-sdk-pandas/shared_invite/zt-sxdx38sl-E0coRfAds8WdpxXD2Nzfrg) * Ask a question on [Stack Overflow](https://stackoverflow.com/questions/tagged/awswrangler) and tag it with `awswrangler` +* [Runbook](https://github.com/aws/aws-sdk-pandas/discussions/1815) for AWS SDK for pandas with Ray ## Community Resources @@ -540,13 +576,12 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q > An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | aws-proserve-opensource@amazon.com -[](https://pypi.org/project/awswrangler/) -[](https://anaconda.org/conda-forge/awswrangler) +[](https://pypi.org/project/awswrangler/) +[](https://anaconda.org/conda-forge/awswrangler) [](https://github.com/psf/black) [](https://opensource.org/licenses/Apache-2.0) [](http://mypy-lang.org/) -[](https://pypi.org/project/awswrangler/)  [](https://aws-sdk-pandas.readthedocs.io/?badge=latest) @@ -555,14 +590,15 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q | **[PyPi](https://pypi.org/project/awswrangler/)** | [](https://pypi.org/project/awswrangler/) | `pip install awswrangler` | | **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` | -> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br> -➡️ `pip install pyarrow==2 awswrangler` +> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br> +➡️`pip install 'awswrangler[redshift]'` Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/) ## Table of contents - [Quick Start](#quick-start) +- [At Scale](#at-scale) - [Read The Docs](#read-the-docs) - [Getting Help](#getting-help) - [Community Resources](#community-resources) @@ -573,8 +609,8 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http Installation command: `pip install awswrangler` -> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br> -➡️`pip install pyarrow==2 awswrangler` +> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br> +➡️`pip install 'awswrangler[redshift]'` ```py3 import awswrangler as wr @@ -625,19 +661,28 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3 ``` +## At scale +AWS SDK for pandas can also run your workflows at scale by leveraging [Modin](https://modin.readthedocs.io/en/stable/) and [Ray](https://www.ray.io/). Both projects aim to speed up data workloads by distributing processing over a cluster of workers. + +The quickest way to get started is to use AWS Glue with Ray. Read our [docs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html), our [blog](https://aws.amazon.com/blogs/big-data/scale-aws-sdk-for-pandas-workloads-with-aws-glue-for-ray/), or head to our latest [tutorials](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) to discover even more features. + ## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/) -- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/about.html) -- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html) - - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#pypi-pip) - - [Conda](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#conda) - - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-lambda-layer) - - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-python-shell-jobs) - - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs) - - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook) - - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook-lifecycle) - - [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr) - - [From source](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#from-source) +- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/what.html) +- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html) + - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#pypi-pip) + - [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#conda) + - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-lambda-layer) + - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-python-shell-jobs) + - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-pyspark-jobs) + - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook) + - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook-lifecycle) + - [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#emr) + - [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#from-source) +- [**At scale**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html) + - [Getting Started](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#getting-started) + - [Supported APIs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#supported-apis) + - [Resources](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#resources) - [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) - [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb) - [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb) @@ -672,30 +717,37 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3 - [031 - OpenSearch](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/031%20-%20OpenSearch.ipynb) - [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb) - [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb) - - [034 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-Glue%20%20Data%20Quality.ipynb) -- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html) - - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-s3) - - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-glue-catalog) - - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-athena) - - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-lake-formation) - - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-redshift) - - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#postgresql) - - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#mysql) - - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#sqlserver) - - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#oracle) - - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-redshift) - - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-rds) - - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#opensearch) - - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-neptune) - - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#dynamodb) - - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-timestream) - - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-emr) - - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-cloudwatch-logs) - - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-chime) - - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-quicksight) - - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-sts) - - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-secrets-manager) - - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#global-configurations) + - [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb) + - [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb) + - [036 - Distributing Calls with Glue Interactive Sessions on Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/036%20-%20Distributing%20Calls%20with%20Glue%20Interactive%20Sessions%20on%20Ray.ipynb) + - [037 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/037%20-%20Glue%20Data%20Quality.ipynb) + - [038 - OpenSearch Serverless](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/038%20-%20OpenSearch%20Serverless.ipynb) + - [039 - Athena Iceberg](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/039%20-%20Athena%20Iceberg.ipynb) +- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html) + - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-s3) + - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-catalog) + - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-athena) + - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-lake-formation) + - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-redshift) + - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#postgresql) + - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#mysql) + - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#sqlserver) + - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#oracle) + - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-redshift) + - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-rds) + - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#opensearch) + - [AWS Glue Data Quality](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-data-quality) + - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-neptune) + - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#dynamodb) + - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-timestream) + - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-emr) + - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-cloudwatch-logs) + - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-chime) + - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-quicksight) + - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-sts) + - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-secrets-manager) + - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#global-configurations) + - [Distributed - Ray](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#distributed-ray) - [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt) - [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md) @@ -706,6 +758,7 @@ You may also find help on these community resources: * The #aws-sdk-pandas Slack [channel](https://join.slack.com/t/aws-sdk-pandas/shared_invite/zt-sxdx38sl-E0coRfAds8WdpxXD2Nzfrg) * Ask a question on [Stack Overflow](https://stackoverflow.com/questions/tagged/awswrangler) and tag it with `awswrangler` +* [Runbook](https://github.com/aws/aws-sdk-pandas/discussions/1815) for AWS SDK for pandas with Ray ## Community Resources @@ -771,7 +824,7 @@ If you would like us to include your company’s name and/or logo in the README %prep -%autosetup -n awswrangler-2.20.1 +%autosetup -n awswrangler-3.0.0 %build %py3_build @@ -811,5 +864,5 @@ mv %{buildroot}/doclist.lst . %{_docdir}/* %changelog -* Mon Apr 10 2023 Python_Bot <Python_Bot@openeuler.org> - 2.20.1-1 +* Fri Apr 21 2023 Python_Bot <Python_Bot@openeuler.org> - 3.0.0-1 - Package Spec generated @@ -1 +1 @@ -e7f848b8677bc6fe97e2cb7cfc504b97 awswrangler-2.20.1.tar.gz +7669878b423a22bffd89d33f75ddbd49 awswrangler-3.0.0.tar.gz |
