diff options
| -rw-r--r-- | .gitignore | 1 | ||||
| -rw-r--r-- | python-pfio.spec | 325 | ||||
| -rw-r--r-- | sources | 1 |
3 files changed, 327 insertions, 0 deletions
@@ -0,0 +1 @@ +/pfio-2.5.1.tar.gz diff --git a/python-pfio.spec b/python-pfio.spec new file mode 100644 index 0000000..dce7620 --- /dev/null +++ b/python-pfio.spec @@ -0,0 +1,325 @@ +%global _empty_manifest_terminate_build 0 +Name: python-pfio +Version: 2.5.1 +Release: 1 +Summary: PFN IO library +License: MIT License +URL: http://github.com/pfnet/pfio +Source0: https://mirrors.nju.edu.cn/pypi/web/packages/d6/22/5fecda9813c3cc0f8e8640cb551495bbdc86aef4b2bc572f1be94055e66f/pfio-2.5.1.tar.gz +BuildArch: noarch + +Requires: python3-pyarrow +Requires: python3-boto3 +Requires: python3-deprecation +Requires: python3-urllib3 +Requires: python3-numpy +Requires: python3-torch +Requires: python3-Pillow +Requires: python3-sphinx +Requires: python3-sphinx-rtd-theme +Requires: python3-pytest +Requires: python3-flake8 +Requires: python3-autopep8 +Requires: python3-parameterized +Requires: python3-isort +Requires: python3-moto[server] +Requires: python3-numpy + +%description +## PFIO + +PFIO is an IO abstraction library developed by PFN, optimized for deep +learning training with batteries included. It supports + +- Filesystem API abstraction with unified error semantics, +- Explicit user-land caching system, +- IO performance tracing and metrics stats, and +- Fileset container utilities to save metadata. + + +## Dependency + +- HDFS client and libhdfs for HDFS access +- CPython >= 3.6 + +## Installation and Document build + +Installation + +```shell +$ git clone https://github.com/pfnet/pfio.git +$ cd pfio +$ pip install . +``` + +Documentation +```sh +$ cd pfio/docs +$ make html +$ open build/html/index.html +``` + +Test +```sh +$ cd pfio +$ pip install .[test] +$ pytest tests/ +``` + +## How to use + +Please refer to the [official document](https://pfio.readthedocs.io) for more information about the usage. + +## Release + +Check [the official document](https://packaging.python.org/tutorials/packaging-projects/) for latest release procedure. + +Run tests locally: + +```sh +$ pip install --user -e .[test] +$ pytest +``` + +Bump version numbers in `pfio/version.py` . + +Push and open a pull request to invoke CI. Once CI passed and the pull request merged, +tag a release: + +```sh +$ git tag -s X.Y.Z +$ git push --tags +``` + +Build: + +```sh +$ rm -rf dist +$ pip3 install --user build +$ python3 -m build +``` + +Release to PyPI: + +```sh +$ python3 -m pip install --user --upgrade twine +$ python3 -m twine upload --repository testpypi dist/* +``` + + +%package -n python3-pfio +Summary: PFN IO library +Provides: python-pfio +BuildRequires: python3-devel +BuildRequires: python3-setuptools +BuildRequires: python3-pip +%description -n python3-pfio +## PFIO + +PFIO is an IO abstraction library developed by PFN, optimized for deep +learning training with batteries included. It supports + +- Filesystem API abstraction with unified error semantics, +- Explicit user-land caching system, +- IO performance tracing and metrics stats, and +- Fileset container utilities to save metadata. + + +## Dependency + +- HDFS client and libhdfs for HDFS access +- CPython >= 3.6 + +## Installation and Document build + +Installation + +```shell +$ git clone https://github.com/pfnet/pfio.git +$ cd pfio +$ pip install . +``` + +Documentation +```sh +$ cd pfio/docs +$ make html +$ open build/html/index.html +``` + +Test +```sh +$ cd pfio +$ pip install .[test] +$ pytest tests/ +``` + +## How to use + +Please refer to the [official document](https://pfio.readthedocs.io) for more information about the usage. + +## Release + +Check [the official document](https://packaging.python.org/tutorials/packaging-projects/) for latest release procedure. + +Run tests locally: + +```sh +$ pip install --user -e .[test] +$ pytest +``` + +Bump version numbers in `pfio/version.py` . + +Push and open a pull request to invoke CI. Once CI passed and the pull request merged, +tag a release: + +```sh +$ git tag -s X.Y.Z +$ git push --tags +``` + +Build: + +```sh +$ rm -rf dist +$ pip3 install --user build +$ python3 -m build +``` + +Release to PyPI: + +```sh +$ python3 -m pip install --user --upgrade twine +$ python3 -m twine upload --repository testpypi dist/* +``` + + +%package help +Summary: Development documents and examples for pfio +Provides: python3-pfio-doc +%description help +## PFIO + +PFIO is an IO abstraction library developed by PFN, optimized for deep +learning training with batteries included. It supports + +- Filesystem API abstraction with unified error semantics, +- Explicit user-land caching system, +- IO performance tracing and metrics stats, and +- Fileset container utilities to save metadata. + + +## Dependency + +- HDFS client and libhdfs for HDFS access +- CPython >= 3.6 + +## Installation and Document build + +Installation + +```shell +$ git clone https://github.com/pfnet/pfio.git +$ cd pfio +$ pip install . +``` + +Documentation +```sh +$ cd pfio/docs +$ make html +$ open build/html/index.html +``` + +Test +```sh +$ cd pfio +$ pip install .[test] +$ pytest tests/ +``` + +## How to use + +Please refer to the [official document](https://pfio.readthedocs.io) for more information about the usage. + +## Release + +Check [the official document](https://packaging.python.org/tutorials/packaging-projects/) for latest release procedure. + +Run tests locally: + +```sh +$ pip install --user -e .[test] +$ pytest +``` + +Bump version numbers in `pfio/version.py` . + +Push and open a pull request to invoke CI. Once CI passed and the pull request merged, +tag a release: + +```sh +$ git tag -s X.Y.Z +$ git push --tags +``` + +Build: + +```sh +$ rm -rf dist +$ pip3 install --user build +$ python3 -m build +``` + +Release to PyPI: + +```sh +$ python3 -m pip install --user --upgrade twine +$ python3 -m twine upload --repository testpypi dist/* +``` + + +%prep +%autosetup -n pfio-2.5.1 + +%build +%py3_build + +%install +%py3_install +install -d -m755 %{buildroot}/%{_pkgdocdir} +if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi +if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi +if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi +if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi +pushd %{buildroot} +if [ -d usr/lib ]; then + find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/lib64 ]; then + find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/bin ]; then + find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/sbin ]; then + find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst +fi +touch doclist.lst +if [ -d usr/share/man ]; then + find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst +fi +popd +mv %{buildroot}/filelist.lst . +mv %{buildroot}/doclist.lst . + +%files -n python3-pfio -f filelist.lst +%dir %{python3_sitelib}/* + +%files help -f doclist.lst +%{_docdir}/* + +%changelog +* Fri May 05 2023 Python_Bot <Python_Bot@openeuler.org> - 2.5.1-1 +- Package Spec generated @@ -0,0 +1 @@ +d889fba64acacb16e0884e9727e620bc pfio-2.5.1.tar.gz |