diff options
| author | CoprDistGit <infra@openeuler.org> | 2023-05-05 06:43:25 +0000 |
|---|---|---|
| committer | CoprDistGit <infra@openeuler.org> | 2023-05-05 06:43:25 +0000 |
| commit | 4e7d6d05db9a8126cee996a222499f0b91f3bbbb (patch) | |
| tree | 82fa765a9d32d8604cd9b1591b6ef17ba01e891f | |
| parent | ef12a776a2538d9a6decdc2954abfe06062cf1a0 (diff) | |
automatic import of python-v3iofsopeneuler20.03
| -rw-r--r-- | .gitignore | 1 | ||||
| -rw-r--r-- | python-v3iofs.spec | 287 | ||||
| -rw-r--r-- | sources | 1 |
3 files changed, 289 insertions, 0 deletions
@@ -0,0 +1 @@ +/v3iofs-0.1.15.tar.gz diff --git a/python-v3iofs.spec b/python-v3iofs.spec new file mode 100644 index 0000000..159595e --- /dev/null +++ b/python-v3iofs.spec @@ -0,0 +1,287 @@ +%global _empty_manifest_terminate_build 0 +Name: python-v3iofs +Version: 0.1.15 +Release: 1 +Summary: fsspec driver for v3io +License: MIT +URL: https://github.com/v3io/v3io-fs +Source0: https://mirrors.nju.edu.cn/pypi/web/packages/4e/8b/13e46428a4bae7c99ce850ebf77469b8b34490064c19cdfef50bbfa538e0/v3iofs-0.1.15.tar.gz +BuildArch: noarch + +Requires: python3-fsspec +Requires: python3-v3io + +%description +# v3iofs + +<!-- +[](https://github.com/v3io/v3io-fs/actions?query=workflow%3ACI) +--> +[](https://opensource.org/licenses/Apache-2.0) + + +An [fsspec][fsspec] driver for [v3io][v3io]. + + +## Examples + + +### Python + +```python +>>> from v3iofs import V3ioFS # Will register 'v3io' protocol in ffspec +>>> fs = V3ioFS('api.app.yh48.iguazio-cd2.com', v3io_access_key='s3cr3t') +>>> fs.ls('/container/path') +``` + +### Pandas + +```python +# Use V3IO_ACCESS_KEY & V3IO_API from environment +>> df = pd.read_csv('v3io://container/path/to/file.csv') +``` + +### Dask + +```python +>>> from v3iofs import V3ioFS +>>> from dask import bag + +# Use V3IO_ACCESS_KEY & V3IO_API from environment +>>> url = 'v3io://container/path' +>>> file = bag.read_text(url) +>>> data, _ = file.compute() + +# Pass key in storage_options +>>> storage_options={ +... 'v3io_api': 'webapi.app.iguazio.com', +... 'v3io_access_key': 's3cr3t', +... } +>>> file = bag.read_text(url, storage_options=storage_options) +>>> data, _ = file.compute() +``` + +## Development + + +### Testing + +You need to set `V3IO_ACCESS_KEY` and `V3IO_API` environment variables. +Then run `make test` to run the tests. + + +### Environment + +Deployment requirements are in `requirements.txt` and development requirements +are in `dev-requirements.txt`. + +``` +$ python -m venv venv +$ ./venv/bin/python -m pip install -r dev-requirements.txt +``` + + +[fsspec]: https://filesystem-spec.readthedocs.io +[v3io]: https://www.iguazio.com/docs/tutorials/latest-release/getting-started/containers/ + + +%package -n python3-v3iofs +Summary: fsspec driver for v3io +Provides: python-v3iofs +BuildRequires: python3-devel +BuildRequires: python3-setuptools +BuildRequires: python3-pip +%description -n python3-v3iofs +# v3iofs + +<!-- +[](https://github.com/v3io/v3io-fs/actions?query=workflow%3ACI) +--> +[](https://opensource.org/licenses/Apache-2.0) + + +An [fsspec][fsspec] driver for [v3io][v3io]. + + +## Examples + + +### Python + +```python +>>> from v3iofs import V3ioFS # Will register 'v3io' protocol in ffspec +>>> fs = V3ioFS('api.app.yh48.iguazio-cd2.com', v3io_access_key='s3cr3t') +>>> fs.ls('/container/path') +``` + +### Pandas + +```python +# Use V3IO_ACCESS_KEY & V3IO_API from environment +>> df = pd.read_csv('v3io://container/path/to/file.csv') +``` + +### Dask + +```python +>>> from v3iofs import V3ioFS +>>> from dask import bag + +# Use V3IO_ACCESS_KEY & V3IO_API from environment +>>> url = 'v3io://container/path' +>>> file = bag.read_text(url) +>>> data, _ = file.compute() + +# Pass key in storage_options +>>> storage_options={ +... 'v3io_api': 'webapi.app.iguazio.com', +... 'v3io_access_key': 's3cr3t', +... } +>>> file = bag.read_text(url, storage_options=storage_options) +>>> data, _ = file.compute() +``` + +## Development + + +### Testing + +You need to set `V3IO_ACCESS_KEY` and `V3IO_API` environment variables. +Then run `make test` to run the tests. + + +### Environment + +Deployment requirements are in `requirements.txt` and development requirements +are in `dev-requirements.txt`. + +``` +$ python -m venv venv +$ ./venv/bin/python -m pip install -r dev-requirements.txt +``` + + +[fsspec]: https://filesystem-spec.readthedocs.io +[v3io]: https://www.iguazio.com/docs/tutorials/latest-release/getting-started/containers/ + + +%package help +Summary: Development documents and examples for v3iofs +Provides: python3-v3iofs-doc +%description help +# v3iofs + +<!-- +[](https://github.com/v3io/v3io-fs/actions?query=workflow%3ACI) +--> +[](https://opensource.org/licenses/Apache-2.0) + + +An [fsspec][fsspec] driver for [v3io][v3io]. + + +## Examples + + +### Python + +```python +>>> from v3iofs import V3ioFS # Will register 'v3io' protocol in ffspec +>>> fs = V3ioFS('api.app.yh48.iguazio-cd2.com', v3io_access_key='s3cr3t') +>>> fs.ls('/container/path') +``` + +### Pandas + +```python +# Use V3IO_ACCESS_KEY & V3IO_API from environment +>> df = pd.read_csv('v3io://container/path/to/file.csv') +``` + +### Dask + +```python +>>> from v3iofs import V3ioFS +>>> from dask import bag + +# Use V3IO_ACCESS_KEY & V3IO_API from environment +>>> url = 'v3io://container/path' +>>> file = bag.read_text(url) +>>> data, _ = file.compute() + +# Pass key in storage_options +>>> storage_options={ +... 'v3io_api': 'webapi.app.iguazio.com', +... 'v3io_access_key': 's3cr3t', +... } +>>> file = bag.read_text(url, storage_options=storage_options) +>>> data, _ = file.compute() +``` + +## Development + + +### Testing + +You need to set `V3IO_ACCESS_KEY` and `V3IO_API` environment variables. +Then run `make test` to run the tests. + + +### Environment + +Deployment requirements are in `requirements.txt` and development requirements +are in `dev-requirements.txt`. + +``` +$ python -m venv venv +$ ./venv/bin/python -m pip install -r dev-requirements.txt +``` + + +[fsspec]: https://filesystem-spec.readthedocs.io +[v3io]: https://www.iguazio.com/docs/tutorials/latest-release/getting-started/containers/ + + +%prep +%autosetup -n v3iofs-0.1.15 + +%build +%py3_build + +%install +%py3_install +install -d -m755 %{buildroot}/%{_pkgdocdir} +if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi +if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi +if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi +if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi +pushd %{buildroot} +if [ -d usr/lib ]; then + find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/lib64 ]; then + find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/bin ]; then + find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/sbin ]; then + find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst +fi +touch doclist.lst +if [ -d usr/share/man ]; then + find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst +fi +popd +mv %{buildroot}/filelist.lst . +mv %{buildroot}/doclist.lst . + +%files -n python3-v3iofs -f filelist.lst +%dir %{python3_sitelib}/* + +%files help -f doclist.lst +%{_docdir}/* + +%changelog +* Fri May 05 2023 Python_Bot <Python_Bot@openeuler.org> - 0.1.15-1 +- Package Spec generated @@ -0,0 +1 @@ +366993f690cf6fe12c250d2ac1f78b64 v3iofs-0.1.15.tar.gz |
