summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorCoprDistGit <infra@openeuler.org>2023-04-21 11:06:33 +0000
committerCoprDistGit <infra@openeuler.org>2023-04-21 11:06:33 +0000
commit032723cd1baf442c8ea65151b1539ff27dec5e14 (patch)
tree199fd128522da9dd832c30b9eb7b08f784655a89
parent1b3fcfd570bf3a2d1104839034a4e0a1084c3a70 (diff)
automatic import of python-awswrangleropeneuler20.03
-rw-r--r--.gitignore1
-rw-r--r--python-awswrangler.spec329
-rw-r--r--sources2
3 files changed, 193 insertions, 139 deletions
diff --git a/.gitignore b/.gitignore
index 9412773..9ea64d9 100644
--- a/.gitignore
+++ b/.gitignore
@@ -1 +1,2 @@
/awswrangler-2.20.1.tar.gz
+/awswrangler-3.0.0.tar.gz
diff --git a/python-awswrangler.spec b/python-awswrangler.spec
index ea30698..1b94955 100644
--- a/python-awswrangler.spec
+++ b/python-awswrangler.spec
@@ -1,33 +1,35 @@
%global _empty_manifest_terminate_build 0
Name: python-awswrangler
-Version: 2.20.1
+Version: 3.0.0
Release: 1
Summary: Pandas on AWS.
License: Apache-2.0
URL: https://aws-sdk-pandas.readthedocs.io/
-Source0: https://mirrors.nju.edu.cn/pypi/web/packages/8b/72/f76290dffdf1a991277702d584dbfd913c1ddb0c4787b1d9e76890da8125/awswrangler-2.20.1.tar.gz
+Source0: https://mirrors.nju.edu.cn/pypi/web/packages/56/ae/43add1a275d7c4f149fa005239b34382e0f9b5a5deef164eb096346b4c46/awswrangler-3.0.0.tar.gz
BuildArch: noarch
Requires: python3-boto3
Requires: python3-botocore
Requires: python3-pandas
Requires: python3-numpy
-Requires: python3-numpy
Requires: python3-pyarrow
+Requires: python3-typing-extensions
Requires: python3-redshift-connector
Requires: python3-pymysql
Requires: python3-pg8000
-Requires: python3-openpyxl
+Requires: python3-pyodbc
+Requires: python3-oracledb
+Requires: python3-gremlinpython
+Requires: python3-SPARQLWrapper
+Requires: python3-requests
+Requires: python3-opensearch-py
Requires: python3-requests-aws4auth
Requires: python3-jsonpath-ng
+Requires: python3-openpyxl
Requires: python3-progressbar2
-Requires: python3-opensearch-py
-Requires: python3-gremlinpython
-Requires: python3-backoff
-Requires: python3-SPARQLWrapper
-Requires: python3-pyodbc
-Requires: python3-oracledb
Requires: python3-deltalake
+Requires: python3-modin
+Requires: python3-ray[data,default]
%description
# AWS SDK for pandas (awswrangler)
@@ -43,13 +45,12 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
> An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | aws-proserve-opensource@amazon.com
-[![Release](https://img.shields.io/badge/release-2.20.1-brightgreen.svg)](https://pypi.org/project/awswrangler/)
-[![Python Version](https://img.shields.io/badge/python-3.7%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler)
+[![Release](https://img.shields.io/badge/3.0.0-brightgreen.svg)](https://pypi.org/project/awswrangler/)
+[![Python Version](https://img.shields.io/badge/python-3.8%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler)
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![Checked with mypy](http://www.mypy-lang.org/static/mypy_badge.svg)](http://mypy-lang.org/)
-[![Coverage](https://img.shields.io/badge/coverage-91%25-brightgreen.svg)](https://pypi.org/project/awswrangler/)
![Static Checking](https://github.com/aws/aws-sdk-pandas/workflows/Static%20Checking/badge.svg?branch=main)
[![Documentation Status](https://readthedocs.org/projects/aws-sdk-pandas/badge/?version=latest)](https://aws-sdk-pandas.readthedocs.io/?badge=latest)
@@ -58,14 +59,15 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
| **[PyPi](https://pypi.org/project/awswrangler/)** | [![PyPI Downloads](https://pepy.tech/badge/awswrangler)](https://pypi.org/project/awswrangler/) | `pip install awswrangler` |
| **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [![Conda Downloads](https://img.shields.io/conda/dn/conda-forge/awswrangler.svg)](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` |
-> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
-➡️ `pip install pyarrow==2 awswrangler`
+> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br>
+➡️`pip install 'awswrangler[redshift]'`
Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/)
## Table of contents
- [Quick Start](#quick-start)
+- [At Scale](#at-scale)
- [Read The Docs](#read-the-docs)
- [Getting Help](#getting-help)
- [Community Resources](#community-resources)
@@ -76,8 +78,8 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http
Installation command: `pip install awswrangler`
-> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
-➡️`pip install pyarrow==2 awswrangler`
+> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br>
+➡️`pip install 'awswrangler[redshift]'`
```py3
import awswrangler as wr
@@ -128,19 +130,28 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3
```
+## At scale
+AWS SDK for pandas can also run your workflows at scale by leveraging [Modin](https://modin.readthedocs.io/en/stable/) and [Ray](https://www.ray.io/). Both projects aim to speed up data workloads by distributing processing over a cluster of workers.
+
+The quickest way to get started is to use AWS Glue with Ray. Read our [docs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html), our [blog](https://aws.amazon.com/blogs/big-data/scale-aws-sdk-for-pandas-workloads-with-aws-glue-for-ray/), or head to our latest [tutorials](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) to discover even more features.
+
## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/)
-- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/about.html)
-- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html)
- - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#pypi-pip)
- - [Conda](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#conda)
- - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-lambda-layer)
- - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-python-shell-jobs)
- - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs)
- - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook)
- - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook-lifecycle)
- - [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr)
- - [From source](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#from-source)
+- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/what.html)
+- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html)
+ - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#pypi-pip)
+ - [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#conda)
+ - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-lambda-layer)
+ - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-python-shell-jobs)
+ - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-pyspark-jobs)
+ - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook)
+ - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook-lifecycle)
+ - [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#emr)
+ - [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#from-source)
+- [**At scale**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html)
+ - [Getting Started](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#getting-started)
+ - [Supported APIs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#supported-apis)
+ - [Resources](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#resources)
- [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials)
- [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb)
- [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb)
@@ -175,30 +186,37 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3
- [031 - OpenSearch](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/031%20-%20OpenSearch.ipynb)
- [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb)
- [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb)
- - [034 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-Glue%20%20Data%20Quality.ipynb)
-- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html)
- - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-s3)
- - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-glue-catalog)
- - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-athena)
- - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-lake-formation)
- - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-redshift)
- - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#postgresql)
- - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#mysql)
- - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#sqlserver)
- - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#oracle)
- - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-redshift)
- - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-rds)
- - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#opensearch)
- - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-neptune)
- - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#dynamodb)
- - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-timestream)
- - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-emr)
- - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-cloudwatch-logs)
- - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-chime)
- - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-quicksight)
- - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-sts)
- - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-secrets-manager)
- - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#global-configurations)
+ - [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb)
+ - [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb)
+ - [036 - Distributing Calls with Glue Interactive Sessions on Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/036%20-%20Distributing%20Calls%20with%20Glue%20Interactive%20Sessions%20on%20Ray.ipynb)
+ - [037 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/037%20-%20Glue%20Data%20Quality.ipynb)
+ - [038 - OpenSearch Serverless](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/038%20-%20OpenSearch%20Serverless.ipynb)
+ - [039 - Athena Iceberg](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/039%20-%20Athena%20Iceberg.ipynb)
+- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html)
+ - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-s3)
+ - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-catalog)
+ - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-athena)
+ - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-lake-formation)
+ - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-redshift)
+ - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#postgresql)
+ - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#mysql)
+ - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#sqlserver)
+ - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#oracle)
+ - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-redshift)
+ - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-rds)
+ - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#opensearch)
+ - [AWS Glue Data Quality](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-data-quality)
+ - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-neptune)
+ - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#dynamodb)
+ - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-timestream)
+ - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-emr)
+ - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-cloudwatch-logs)
+ - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-chime)
+ - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-quicksight)
+ - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-sts)
+ - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-secrets-manager)
+ - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#global-configurations)
+ - [Distributed - Ray](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#distributed-ray)
- [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt)
- [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md)
@@ -209,6 +227,7 @@ You may also find help on these community resources:
* The #aws-sdk-pandas Slack [channel](https://join.slack.com/t/aws-sdk-pandas/shared_invite/zt-sxdx38sl-E0coRfAds8WdpxXD2Nzfrg)
* Ask a question on [Stack Overflow](https://stackoverflow.com/questions/tagged/awswrangler)
and tag it with `awswrangler`
+* [Runbook](https://github.com/aws/aws-sdk-pandas/discussions/1815) for AWS SDK for pandas with Ray
## Community Resources
@@ -293,13 +312,12 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
> An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | aws-proserve-opensource@amazon.com
-[![Release](https://img.shields.io/badge/release-2.20.1-brightgreen.svg)](https://pypi.org/project/awswrangler/)
-[![Python Version](https://img.shields.io/badge/python-3.7%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler)
+[![Release](https://img.shields.io/badge/3.0.0-brightgreen.svg)](https://pypi.org/project/awswrangler/)
+[![Python Version](https://img.shields.io/badge/python-3.8%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler)
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![Checked with mypy](http://www.mypy-lang.org/static/mypy_badge.svg)](http://mypy-lang.org/)
-[![Coverage](https://img.shields.io/badge/coverage-91%25-brightgreen.svg)](https://pypi.org/project/awswrangler/)
![Static Checking](https://github.com/aws/aws-sdk-pandas/workflows/Static%20Checking/badge.svg?branch=main)
[![Documentation Status](https://readthedocs.org/projects/aws-sdk-pandas/badge/?version=latest)](https://aws-sdk-pandas.readthedocs.io/?badge=latest)
@@ -308,14 +326,15 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
| **[PyPi](https://pypi.org/project/awswrangler/)** | [![PyPI Downloads](https://pepy.tech/badge/awswrangler)](https://pypi.org/project/awswrangler/) | `pip install awswrangler` |
| **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [![Conda Downloads](https://img.shields.io/conda/dn/conda-forge/awswrangler.svg)](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` |
-> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
-➡️ `pip install pyarrow==2 awswrangler`
+> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br>
+➡️`pip install 'awswrangler[redshift]'`
Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/)
## Table of contents
- [Quick Start](#quick-start)
+- [At Scale](#at-scale)
- [Read The Docs](#read-the-docs)
- [Getting Help](#getting-help)
- [Community Resources](#community-resources)
@@ -326,8 +345,8 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http
Installation command: `pip install awswrangler`
-> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
-➡️`pip install pyarrow==2 awswrangler`
+> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br>
+➡️`pip install 'awswrangler[redshift]'`
```py3
import awswrangler as wr
@@ -378,19 +397,28 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3
```
+## At scale
+AWS SDK for pandas can also run your workflows at scale by leveraging [Modin](https://modin.readthedocs.io/en/stable/) and [Ray](https://www.ray.io/). Both projects aim to speed up data workloads by distributing processing over a cluster of workers.
+
+The quickest way to get started is to use AWS Glue with Ray. Read our [docs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html), our [blog](https://aws.amazon.com/blogs/big-data/scale-aws-sdk-for-pandas-workloads-with-aws-glue-for-ray/), or head to our latest [tutorials](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) to discover even more features.
+
## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/)
-- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/about.html)
-- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html)
- - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#pypi-pip)
- - [Conda](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#conda)
- - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-lambda-layer)
- - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-python-shell-jobs)
- - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs)
- - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook)
- - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook-lifecycle)
- - [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr)
- - [From source](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#from-source)
+- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/what.html)
+- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html)
+ - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#pypi-pip)
+ - [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#conda)
+ - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-lambda-layer)
+ - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-python-shell-jobs)
+ - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-pyspark-jobs)
+ - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook)
+ - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook-lifecycle)
+ - [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#emr)
+ - [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#from-source)
+- [**At scale**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html)
+ - [Getting Started](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#getting-started)
+ - [Supported APIs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#supported-apis)
+ - [Resources](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#resources)
- [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials)
- [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb)
- [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb)
@@ -425,30 +453,37 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3
- [031 - OpenSearch](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/031%20-%20OpenSearch.ipynb)
- [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb)
- [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb)
- - [034 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-Glue%20%20Data%20Quality.ipynb)
-- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html)
- - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-s3)
- - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-glue-catalog)
- - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-athena)
- - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-lake-formation)
- - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-redshift)
- - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#postgresql)
- - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#mysql)
- - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#sqlserver)
- - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#oracle)
- - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-redshift)
- - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-rds)
- - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#opensearch)
- - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-neptune)
- - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#dynamodb)
- - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-timestream)
- - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-emr)
- - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-cloudwatch-logs)
- - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-chime)
- - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-quicksight)
- - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-sts)
- - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-secrets-manager)
- - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#global-configurations)
+ - [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb)
+ - [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb)
+ - [036 - Distributing Calls with Glue Interactive Sessions on Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/036%20-%20Distributing%20Calls%20with%20Glue%20Interactive%20Sessions%20on%20Ray.ipynb)
+ - [037 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/037%20-%20Glue%20Data%20Quality.ipynb)
+ - [038 - OpenSearch Serverless](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/038%20-%20OpenSearch%20Serverless.ipynb)
+ - [039 - Athena Iceberg](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/039%20-%20Athena%20Iceberg.ipynb)
+- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html)
+ - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-s3)
+ - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-catalog)
+ - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-athena)
+ - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-lake-formation)
+ - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-redshift)
+ - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#postgresql)
+ - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#mysql)
+ - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#sqlserver)
+ - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#oracle)
+ - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-redshift)
+ - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-rds)
+ - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#opensearch)
+ - [AWS Glue Data Quality](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-data-quality)
+ - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-neptune)
+ - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#dynamodb)
+ - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-timestream)
+ - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-emr)
+ - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-cloudwatch-logs)
+ - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-chime)
+ - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-quicksight)
+ - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-sts)
+ - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-secrets-manager)
+ - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#global-configurations)
+ - [Distributed - Ray](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#distributed-ray)
- [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt)
- [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md)
@@ -459,6 +494,7 @@ You may also find help on these community resources:
* The #aws-sdk-pandas Slack [channel](https://join.slack.com/t/aws-sdk-pandas/shared_invite/zt-sxdx38sl-E0coRfAds8WdpxXD2Nzfrg)
* Ask a question on [Stack Overflow](https://stackoverflow.com/questions/tagged/awswrangler)
and tag it with `awswrangler`
+* [Runbook](https://github.com/aws/aws-sdk-pandas/discussions/1815) for AWS SDK for pandas with Ray
## Community Resources
@@ -540,13 +576,12 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
> An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | aws-proserve-opensource@amazon.com
-[![Release](https://img.shields.io/badge/release-2.20.1-brightgreen.svg)](https://pypi.org/project/awswrangler/)
-[![Python Version](https://img.shields.io/badge/python-3.7%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler)
+[![Release](https://img.shields.io/badge/3.0.0-brightgreen.svg)](https://pypi.org/project/awswrangler/)
+[![Python Version](https://img.shields.io/badge/python-3.8%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler)
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![Checked with mypy](http://www.mypy-lang.org/static/mypy_badge.svg)](http://mypy-lang.org/)
-[![Coverage](https://img.shields.io/badge/coverage-91%25-brightgreen.svg)](https://pypi.org/project/awswrangler/)
![Static Checking](https://github.com/aws/aws-sdk-pandas/workflows/Static%20Checking/badge.svg?branch=main)
[![Documentation Status](https://readthedocs.org/projects/aws-sdk-pandas/badge/?version=latest)](https://aws-sdk-pandas.readthedocs.io/?badge=latest)
@@ -555,14 +590,15 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
| **[PyPi](https://pypi.org/project/awswrangler/)** | [![PyPI Downloads](https://pepy.tech/badge/awswrangler)](https://pypi.org/project/awswrangler/) | `pip install awswrangler` |
| **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [![Conda Downloads](https://img.shields.io/conda/dn/conda-forge/awswrangler.svg)](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` |
-> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
-➡️ `pip install pyarrow==2 awswrangler`
+> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br>
+➡️`pip install 'awswrangler[redshift]'`
Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/)
## Table of contents
- [Quick Start](#quick-start)
+- [At Scale](#at-scale)
- [Read The Docs](#read-the-docs)
- [Getting Help](#getting-help)
- [Community Resources](#community-resources)
@@ -573,8 +609,8 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http
Installation command: `pip install awswrangler`
-> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
-➡️`pip install pyarrow==2 awswrangler`
+> ⚠️ **Starting version 3.0, optional modules must be installed explicitly:**<br>
+➡️`pip install 'awswrangler[redshift]'`
```py3
import awswrangler as wr
@@ -625,19 +661,28 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3
```
+## At scale
+AWS SDK for pandas can also run your workflows at scale by leveraging [Modin](https://modin.readthedocs.io/en/stable/) and [Ray](https://www.ray.io/). Both projects aim to speed up data workloads by distributing processing over a cluster of workers.
+
+The quickest way to get started is to use AWS Glue with Ray. Read our [docs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html), our [blog](https://aws.amazon.com/blogs/big-data/scale-aws-sdk-for-pandas-workloads-with-aws-glue-for-ray/), or head to our latest [tutorials](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) to discover even more features.
+
## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/)
-- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/about.html)
-- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html)
- - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#pypi-pip)
- - [Conda](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#conda)
- - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-lambda-layer)
- - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-python-shell-jobs)
- - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#aws-glue-pyspark-jobs)
- - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook)
- - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#amazon-sagemaker-notebook-lifecycle)
- - [EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#emr)
- - [From source](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/install.html#from-source)
+- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/what.html)
+- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html)
+ - [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#pypi-pip)
+ - [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#conda)
+ - [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-lambda-layer)
+ - [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-python-shell-jobs)
+ - [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#aws-glue-pyspark-jobs)
+ - [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook)
+ - [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#amazon-sagemaker-notebook-lifecycle)
+ - [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#emr)
+ - [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/install.html#from-source)
+- [**At scale**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html)
+ - [Getting Started](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#getting-started)
+ - [Supported APIs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#supported-apis)
+ - [Resources](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/scale.html#resources)
- [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials)
- [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb)
- [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb)
@@ -672,30 +717,37 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3
- [031 - OpenSearch](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/031%20-%20OpenSearch.ipynb)
- [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb)
- [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb)
- - [034 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-Glue%20%20Data%20Quality.ipynb)
-- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html)
- - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-s3)
- - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-glue-catalog)
- - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-athena)
- - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-lake-formation)
- - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-redshift)
- - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#postgresql)
- - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#mysql)
- - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#sqlserver)
- - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#oracle)
- - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-redshift)
- - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#data-api-rds)
- - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#opensearch)
- - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-neptune)
- - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#dynamodb)
- - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-timestream)
- - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-emr)
- - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-cloudwatch-logs)
- - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-chime)
- - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#amazon-quicksight)
- - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-sts)
- - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#aws-secrets-manager)
- - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/2.20.1/api.html#global-configurations)
+ - [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb)
+ - [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb)
+ - [036 - Distributing Calls with Glue Interactive Sessions on Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/036%20-%20Distributing%20Calls%20with%20Glue%20Interactive%20Sessions%20on%20Ray.ipynb)
+ - [037 - Glue Data Quality](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/037%20-%20Glue%20Data%20Quality.ipynb)
+ - [038 - OpenSearch Serverless](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/038%20-%20OpenSearch%20Serverless.ipynb)
+ - [039 - Athena Iceberg](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/039%20-%20Athena%20Iceberg.ipynb)
+- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html)
+ - [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-s3)
+ - [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-catalog)
+ - [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-athena)
+ - [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-lake-formation)
+ - [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-redshift)
+ - [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#postgresql)
+ - [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#mysql)
+ - [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#sqlserver)
+ - [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#oracle)
+ - [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-redshift)
+ - [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#data-api-rds)
+ - [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#opensearch)
+ - [AWS Glue Data Quality](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-glue-data-quality)
+ - [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-neptune)
+ - [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#dynamodb)
+ - [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-timestream)
+ - [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-emr)
+ - [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-cloudwatch-logs)
+ - [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-chime)
+ - [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#amazon-quicksight)
+ - [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-sts)
+ - [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#aws-secrets-manager)
+ - [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#global-configurations)
+ - [Distributed - Ray](https://aws-sdk-pandas.readthedocs.io/en/3.0.0/api.html#distributed-ray)
- [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt)
- [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md)
@@ -706,6 +758,7 @@ You may also find help on these community resources:
* The #aws-sdk-pandas Slack [channel](https://join.slack.com/t/aws-sdk-pandas/shared_invite/zt-sxdx38sl-E0coRfAds8WdpxXD2Nzfrg)
* Ask a question on [Stack Overflow](https://stackoverflow.com/questions/tagged/awswrangler)
and tag it with `awswrangler`
+* [Runbook](https://github.com/aws/aws-sdk-pandas/discussions/1815) for AWS SDK for pandas with Ray
## Community Resources
@@ -771,7 +824,7 @@ If you would like us to include your company’s name and/or logo in the README
%prep
-%autosetup -n awswrangler-2.20.1
+%autosetup -n awswrangler-3.0.0
%build
%py3_build
@@ -811,5 +864,5 @@ mv %{buildroot}/doclist.lst .
%{_docdir}/*
%changelog
-* Mon Apr 10 2023 Python_Bot <Python_Bot@openeuler.org> - 2.20.1-1
+* Fri Apr 21 2023 Python_Bot <Python_Bot@openeuler.org> - 3.0.0-1
- Package Spec generated
diff --git a/sources b/sources
index f93c928..bebe8fb 100644
--- a/sources
+++ b/sources
@@ -1 +1 @@
-e7f848b8677bc6fe97e2cb7cfc504b97 awswrangler-2.20.1.tar.gz
+7669878b423a22bffd89d33f75ddbd49 awswrangler-3.0.0.tar.gz