1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
|
%global _empty_manifest_terminate_build 0
Name: python-FireSpark
Version: 0.0.32
Release: 1
Summary: FireSpark data processing utility library
License: Apache License 2.0
URL: https://elc-github.magna.global/Magna-Autonomous-Systems/FireSpark
Source0: https://mirrors.nju.edu.cn/pypi/web/packages/26/06/b2466e8c01e47cdf9837506c60810cb6c325d07fcdf5e2d8e57840241b81/FireSpark-0.0.32.tar.gz
BuildArch: noarch
Requires: python3-absl-py
Requires: python3-protobuf
Requires: python3-boto3
Requires: python3-s3fs
Requires: python3-urllib3
Requires: python3-numpy
Requires: python3-packaging
Requires: python3-pandas
Requires: python3-psutil
Requires: python3-pyspark
Requires: python3-pyzmq
Requires: python3-pyarrow
Requires: python3-six
Requires: python3-petastorm
Requires: python3-tqdm
Requires: python3-opencv-python
Requires: python3-imgaug
Requires: python3-opencv-python
Requires: python3-Pillow
Requires: python3-codecov
Requires: python3-mock
Requires: python3-opencv-python
Requires: python3-flake8
Requires: python3-pylint
Requires: python3-pytest
Requires: python3-pytest-cov
Requires: python3-pytest-forked
Requires: python3-pytest-logger
Requires: python3-pytest-timeout
Requires: python3-s3fs
Requires: python3-gcsfs
Requires: python3-tensorflow
Requires: python3-tensorflow-datasets
Requires: python3-tensorflow-gpu
Requires: python3-torchvision
Requires: python3-torch
%description
FireSpark aims to provide Magna ML/MAS team a flexible and standardized library supporting data processing, management, dataset curation, and ETL related activities.
A dataset created using FireSpark is stored in [Apache Parquet](https://parquet.apache.org/) format. On top of a Parquet
schema, FireSpark takes advantage of open source [Petastorm](https://github.com/uber/petastorm) library to support multidimensional arrays.
**This repo is at its early phase development stage. Please contact [me](hai.yu1@magna.com) if you have question, especially on contributing use case specification, requirements, suggestions.** :innocent:
%package -n python3-FireSpark
Summary: FireSpark data processing utility library
Provides: python-FireSpark
BuildRequires: python3-devel
BuildRequires: python3-setuptools
BuildRequires: python3-pip
%description -n python3-FireSpark
FireSpark aims to provide Magna ML/MAS team a flexible and standardized library supporting data processing, management, dataset curation, and ETL related activities.
A dataset created using FireSpark is stored in [Apache Parquet](https://parquet.apache.org/) format. On top of a Parquet
schema, FireSpark takes advantage of open source [Petastorm](https://github.com/uber/petastorm) library to support multidimensional arrays.
**This repo is at its early phase development stage. Please contact [me](hai.yu1@magna.com) if you have question, especially on contributing use case specification, requirements, suggestions.** :innocent:
%package help
Summary: Development documents and examples for FireSpark
Provides: python3-FireSpark-doc
%description help
FireSpark aims to provide Magna ML/MAS team a flexible and standardized library supporting data processing, management, dataset curation, and ETL related activities.
A dataset created using FireSpark is stored in [Apache Parquet](https://parquet.apache.org/) format. On top of a Parquet
schema, FireSpark takes advantage of open source [Petastorm](https://github.com/uber/petastorm) library to support multidimensional arrays.
**This repo is at its early phase development stage. Please contact [me](hai.yu1@magna.com) if you have question, especially on contributing use case specification, requirements, suggestions.** :innocent:
%prep
%autosetup -n FireSpark-0.0.32
%build
%py3_build
%install
%py3_install
install -d -m755 %{buildroot}/%{_pkgdocdir}
if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi
if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi
if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi
if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi
pushd %{buildroot}
if [ -d usr/lib ]; then
find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst
fi
if [ -d usr/lib64 ]; then
find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst
fi
if [ -d usr/bin ]; then
find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst
fi
if [ -d usr/sbin ]; then
find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst
fi
touch doclist.lst
if [ -d usr/share/man ]; then
find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst
fi
popd
mv %{buildroot}/filelist.lst .
mv %{buildroot}/doclist.lst .
%files -n python3-FireSpark -f filelist.lst
%dir %{python3_sitelib}/*
%files help -f doclist.lst
%{_docdir}/*
%changelog
* Wed May 31 2023 Python_Bot <Python_Bot@openeuler.org> - 0.0.32-1
- Package Spec generated
|
