diff options
| -rw-r--r-- | .gitignore | 1 | ||||
| -rw-r--r-- | python-revscoring.spec | 534 | ||||
| -rw-r--r-- | sources | 1 |
3 files changed, 536 insertions, 0 deletions
@@ -0,0 +1 @@ +/revscoring-2.11.10.tar.gz diff --git a/python-revscoring.spec b/python-revscoring.spec new file mode 100644 index 0000000..14d1d3a --- /dev/null +++ b/python-revscoring.spec @@ -0,0 +1,534 @@ +%global _empty_manifest_terminate_build 0 +Name: python-revscoring +Version: 2.11.10 +Release: 1 +Summary: A set of utilities for generating quality scores for MediaWiki revisions +License: MIT +URL: https://github.com/wikimedia/revscoring +Source0: https://mirrors.nju.edu.cn/pypi/web/packages/8a/c2/0d4c96767b6a66044b61735c100b3a2f45f79d3af1142afd4303b32c0674/revscoring-2.11.10.tar.gz +BuildArch: noarch + +Requires: python3-Cython +Requires: python3-deep-merge +Requires: python3-deltas +Requires: python3-docopt +Requires: python3-gensim +Requires: python3-hanziconv +Requires: python3-mmh3 +Requires: python3-more-itertools +Requires: python3-mwapi +Requires: python3-mwbase +Requires: python3-mwtypes +Requires: python3-mwparserfromhell +Requires: python3-mysqltsv +Requires: python3-nltk +Requires: python3-numpy +Requires: python3-pytz +Requires: python3-requests +Requires: python3-pyenchant +Requires: python3-scipy +Requires: python3-scikit-learn +Requires: python3-tabulate +Requires: python3-tqdm +Requires: python3-yamlconf +Requires: python3-flashtext + +%description +[](https://travis-ci.org/wikimedia/revscoring) +[](https://codecov.io/gh/wikimedia/revscoring) +[](./LICENSE) +[](https://badge.fury.io/py/revscoring) +# Revision Scoring + +A generic, machine learning-based revision scoring system designed to help automate critical wiki-work — for example, vandalism detection and removal. This library powers [ORES](https://ores.wikimedia.org). + +## Example + + +Using a scorer_model to score a revision:: +```python + import mwapi + from revscoring import Model + from revscoring.extractors.api.extractor import Extractor + + with open("models/enwiki.damaging.linear_svc.model") as f: + scorer_model = Model.load(f) + + extractor = Extractor(mwapi.Session(host="https://en.wikipedia.org", + user_agent="revscoring demo")) + + feature_values = list(extractor.extract(123456789, scorer_model.features)) + + print(scorer_model.score(feature_values)) + {'prediction': True, 'probability': {False: 0.4694409344514984, True: 0.5305590655485017}} + ``` + + +# Installation + +The easiest way to install is via the Python package installer +(pip). + +``pip install revscoring`` + +You may find that some of the dependencies fail to compile (namely +`scipy`, `numpy` and `sklearn`). In that case, you'll need to install some +dependencies in your operating system. + +### Ubuntu & Debian: + * Run ``sudo apt-get install python3-dev g++ gfortran liblapack-dev libopenblas-dev enchant`` + * Run ``sudo apt-get install aspell-ar aspell-bn aspell-el aspell-id aspell-is aspell-pl aspell-ro aspell-sv aspell-ta aspell-uk myspell-cs myspell-de-at myspell-de-ch myspell-de-de myspell-es myspell-et myspell-fa myspell-fr myspell-he myspell-hr myspell-hu myspell-lv myspell-nb myspell-nl myspell-pt-pt myspell-pt-br myspell-ru myspell-hr hunspell-bs hunspell-ca hunspell-en-au hunspell-en-us hunspell-en-gb hunspell-eu hunspell-gl hunspell-it hunspell-hi hunspell-sr hunspell-vi voikko-fi`` +<!-- ### Windows: +<i>TODO</i> +--> +### MacOS: + Using Homebrew and pip, installing `revscoring` and `enchant` can be accomplished + as follows:: + +```bash +brew install aspell --with-all-languages +brew install enchant +pip install --no-binary pyenchant revscoring +``` + +#### Adding languages in aspell (MacOS only) + +```bash +cd /tmp +wget http://ftp.gnu.org/gnu/aspell/dict/pt/aspell-pt-0.50-2.tar.bz2 +bzip2 -dc aspell-pt-0.50-2.tar.bz2 | tar xvf - +cd aspell-pt-0.50-2 +./configure +make +sudo make install +``` + + Caveats: <br> + <b><u> The differences between the `aspell` and `myspell` dictionaries can cause </b> + <b> <u>some of the tests to fail </b> + + +Finally, in order to make use of language features, you'll need to download +some NLTK data. The following command will get the necessary corpora. + +``python -m nltk.downloader omw sentiwordnet stopwords wordnet`` + +You'll also need to install [enchant](https://en.wikipedia.org/wiki/Enchant_(software))-compatible +dictionaries of the languages you'd like to use. We recommend the following: + +* languages.arabic: aspell-ar +* languages.basque: hunspell-eu +* languages.bengali: aspell-bn +* languages.bosnian: hunspell-bs +* languages.catalan: myspell-ca +* languages.czech: myspell-cs +* languages.croatian: myspell-hr +* languages.dutch: myspell-nl +* languages.english: myspell-en-us myspell-en-gb myspell-en-au +* languages.estonian: myspell-et +* languages.finnish: voikko-fi +* languages.french: myspell-fr +* languages.galician: hunspell-gl +* languages.german: myspell-de-at myspell-de-ch myspell-de-de +* languages.greek: aspell-el +* languages.hebrew: myspell-he +* languages.hindi: aspell-hi +* languages.hungarian: myspell-hu +* languages.icelandic: aspell-is +* languages.indonesian: aspell-id +* languages.italian: myspell-it +* languages.latvian: myspell-lv +* languages.norwegian: myspell-nb +* languages.persian: myspell-fa +* languages.polish: aspell-pl +* languages.portuguese: myspell-pt-pt myspell-pt-br +* languages.serbian: hunspell-sr +* languages.spanish: myspell-es +* languages.swedish: aspell-sv +* languages.tamil: aspell-ta +* languages.russian: myspell-ru +* languages.ukrainian: aspell-uk +* languages.vietnamese: hunspell-vi + +# Development +To contribute, ensure to install the dependencies: +```bash +$ pip install -r requirements.txt +``` + +Install necessary NLTK data: + +``python -m nltk.downloader omw sentiwordnet stopwords wordnet`` + +## Running tests +Make sure you install test dependencies: + +```bash +$ pip install -r test-requirements.txt +``` + +Then run: + +```bash +$ pytest . -vv +``` +# Reporting bugs +To report a bug, please use [Phabricator](https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=revscoring) + +# Authors + * [Aaron Halfaker](http://halfaker.info) + * [Helder](https://github.com/he7d3r) + * [Adam Roses Wight](https://mediawiki.org/wiki/User:Adamw) + * [Amir Sarabadani](https://github.com/Ladsgroup) + + +%package -n python3-revscoring +Summary: A set of utilities for generating quality scores for MediaWiki revisions +Provides: python-revscoring +BuildRequires: python3-devel +BuildRequires: python3-setuptools +BuildRequires: python3-pip +%description -n python3-revscoring +[](https://travis-ci.org/wikimedia/revscoring) +[](https://codecov.io/gh/wikimedia/revscoring) +[](./LICENSE) +[](https://badge.fury.io/py/revscoring) +# Revision Scoring + +A generic, machine learning-based revision scoring system designed to help automate critical wiki-work — for example, vandalism detection and removal. This library powers [ORES](https://ores.wikimedia.org). + +## Example + + +Using a scorer_model to score a revision:: +```python + import mwapi + from revscoring import Model + from revscoring.extractors.api.extractor import Extractor + + with open("models/enwiki.damaging.linear_svc.model") as f: + scorer_model = Model.load(f) + + extractor = Extractor(mwapi.Session(host="https://en.wikipedia.org", + user_agent="revscoring demo")) + + feature_values = list(extractor.extract(123456789, scorer_model.features)) + + print(scorer_model.score(feature_values)) + {'prediction': True, 'probability': {False: 0.4694409344514984, True: 0.5305590655485017}} + ``` + + +# Installation + +The easiest way to install is via the Python package installer +(pip). + +``pip install revscoring`` + +You may find that some of the dependencies fail to compile (namely +`scipy`, `numpy` and `sklearn`). In that case, you'll need to install some +dependencies in your operating system. + +### Ubuntu & Debian: + * Run ``sudo apt-get install python3-dev g++ gfortran liblapack-dev libopenblas-dev enchant`` + * Run ``sudo apt-get install aspell-ar aspell-bn aspell-el aspell-id aspell-is aspell-pl aspell-ro aspell-sv aspell-ta aspell-uk myspell-cs myspell-de-at myspell-de-ch myspell-de-de myspell-es myspell-et myspell-fa myspell-fr myspell-he myspell-hr myspell-hu myspell-lv myspell-nb myspell-nl myspell-pt-pt myspell-pt-br myspell-ru myspell-hr hunspell-bs hunspell-ca hunspell-en-au hunspell-en-us hunspell-en-gb hunspell-eu hunspell-gl hunspell-it hunspell-hi hunspell-sr hunspell-vi voikko-fi`` +<!-- ### Windows: +<i>TODO</i> +--> +### MacOS: + Using Homebrew and pip, installing `revscoring` and `enchant` can be accomplished + as follows:: + +```bash +brew install aspell --with-all-languages +brew install enchant +pip install --no-binary pyenchant revscoring +``` + +#### Adding languages in aspell (MacOS only) + +```bash +cd /tmp +wget http://ftp.gnu.org/gnu/aspell/dict/pt/aspell-pt-0.50-2.tar.bz2 +bzip2 -dc aspell-pt-0.50-2.tar.bz2 | tar xvf - +cd aspell-pt-0.50-2 +./configure +make +sudo make install +``` + + Caveats: <br> + <b><u> The differences between the `aspell` and `myspell` dictionaries can cause </b> + <b> <u>some of the tests to fail </b> + + +Finally, in order to make use of language features, you'll need to download +some NLTK data. The following command will get the necessary corpora. + +``python -m nltk.downloader omw sentiwordnet stopwords wordnet`` + +You'll also need to install [enchant](https://en.wikipedia.org/wiki/Enchant_(software))-compatible +dictionaries of the languages you'd like to use. We recommend the following: + +* languages.arabic: aspell-ar +* languages.basque: hunspell-eu +* languages.bengali: aspell-bn +* languages.bosnian: hunspell-bs +* languages.catalan: myspell-ca +* languages.czech: myspell-cs +* languages.croatian: myspell-hr +* languages.dutch: myspell-nl +* languages.english: myspell-en-us myspell-en-gb myspell-en-au +* languages.estonian: myspell-et +* languages.finnish: voikko-fi +* languages.french: myspell-fr +* languages.galician: hunspell-gl +* languages.german: myspell-de-at myspell-de-ch myspell-de-de +* languages.greek: aspell-el +* languages.hebrew: myspell-he +* languages.hindi: aspell-hi +* languages.hungarian: myspell-hu +* languages.icelandic: aspell-is +* languages.indonesian: aspell-id +* languages.italian: myspell-it +* languages.latvian: myspell-lv +* languages.norwegian: myspell-nb +* languages.persian: myspell-fa +* languages.polish: aspell-pl +* languages.portuguese: myspell-pt-pt myspell-pt-br +* languages.serbian: hunspell-sr +* languages.spanish: myspell-es +* languages.swedish: aspell-sv +* languages.tamil: aspell-ta +* languages.russian: myspell-ru +* languages.ukrainian: aspell-uk +* languages.vietnamese: hunspell-vi + +# Development +To contribute, ensure to install the dependencies: +```bash +$ pip install -r requirements.txt +``` + +Install necessary NLTK data: + +``python -m nltk.downloader omw sentiwordnet stopwords wordnet`` + +## Running tests +Make sure you install test dependencies: + +```bash +$ pip install -r test-requirements.txt +``` + +Then run: + +```bash +$ pytest . -vv +``` +# Reporting bugs +To report a bug, please use [Phabricator](https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=revscoring) + +# Authors + * [Aaron Halfaker](http://halfaker.info) + * [Helder](https://github.com/he7d3r) + * [Adam Roses Wight](https://mediawiki.org/wiki/User:Adamw) + * [Amir Sarabadani](https://github.com/Ladsgroup) + + +%package help +Summary: Development documents and examples for revscoring +Provides: python3-revscoring-doc +%description help +[](https://travis-ci.org/wikimedia/revscoring) +[](https://codecov.io/gh/wikimedia/revscoring) +[](./LICENSE) +[](https://badge.fury.io/py/revscoring) +# Revision Scoring + +A generic, machine learning-based revision scoring system designed to help automate critical wiki-work — for example, vandalism detection and removal. This library powers [ORES](https://ores.wikimedia.org). + +## Example + + +Using a scorer_model to score a revision:: +```python + import mwapi + from revscoring import Model + from revscoring.extractors.api.extractor import Extractor + + with open("models/enwiki.damaging.linear_svc.model") as f: + scorer_model = Model.load(f) + + extractor = Extractor(mwapi.Session(host="https://en.wikipedia.org", + user_agent="revscoring demo")) + + feature_values = list(extractor.extract(123456789, scorer_model.features)) + + print(scorer_model.score(feature_values)) + {'prediction': True, 'probability': {False: 0.4694409344514984, True: 0.5305590655485017}} + ``` + + +# Installation + +The easiest way to install is via the Python package installer +(pip). + +``pip install revscoring`` + +You may find that some of the dependencies fail to compile (namely +`scipy`, `numpy` and `sklearn`). In that case, you'll need to install some +dependencies in your operating system. + +### Ubuntu & Debian: + * Run ``sudo apt-get install python3-dev g++ gfortran liblapack-dev libopenblas-dev enchant`` + * Run ``sudo apt-get install aspell-ar aspell-bn aspell-el aspell-id aspell-is aspell-pl aspell-ro aspell-sv aspell-ta aspell-uk myspell-cs myspell-de-at myspell-de-ch myspell-de-de myspell-es myspell-et myspell-fa myspell-fr myspell-he myspell-hr myspell-hu myspell-lv myspell-nb myspell-nl myspell-pt-pt myspell-pt-br myspell-ru myspell-hr hunspell-bs hunspell-ca hunspell-en-au hunspell-en-us hunspell-en-gb hunspell-eu hunspell-gl hunspell-it hunspell-hi hunspell-sr hunspell-vi voikko-fi`` +<!-- ### Windows: +<i>TODO</i> +--> +### MacOS: + Using Homebrew and pip, installing `revscoring` and `enchant` can be accomplished + as follows:: + +```bash +brew install aspell --with-all-languages +brew install enchant +pip install --no-binary pyenchant revscoring +``` + +#### Adding languages in aspell (MacOS only) + +```bash +cd /tmp +wget http://ftp.gnu.org/gnu/aspell/dict/pt/aspell-pt-0.50-2.tar.bz2 +bzip2 -dc aspell-pt-0.50-2.tar.bz2 | tar xvf - +cd aspell-pt-0.50-2 +./configure +make +sudo make install +``` + + Caveats: <br> + <b><u> The differences between the `aspell` and `myspell` dictionaries can cause </b> + <b> <u>some of the tests to fail </b> + + +Finally, in order to make use of language features, you'll need to download +some NLTK data. The following command will get the necessary corpora. + +``python -m nltk.downloader omw sentiwordnet stopwords wordnet`` + +You'll also need to install [enchant](https://en.wikipedia.org/wiki/Enchant_(software))-compatible +dictionaries of the languages you'd like to use. We recommend the following: + +* languages.arabic: aspell-ar +* languages.basque: hunspell-eu +* languages.bengali: aspell-bn +* languages.bosnian: hunspell-bs +* languages.catalan: myspell-ca +* languages.czech: myspell-cs +* languages.croatian: myspell-hr +* languages.dutch: myspell-nl +* languages.english: myspell-en-us myspell-en-gb myspell-en-au +* languages.estonian: myspell-et +* languages.finnish: voikko-fi +* languages.french: myspell-fr +* languages.galician: hunspell-gl +* languages.german: myspell-de-at myspell-de-ch myspell-de-de +* languages.greek: aspell-el +* languages.hebrew: myspell-he +* languages.hindi: aspell-hi +* languages.hungarian: myspell-hu +* languages.icelandic: aspell-is +* languages.indonesian: aspell-id +* languages.italian: myspell-it +* languages.latvian: myspell-lv +* languages.norwegian: myspell-nb +* languages.persian: myspell-fa +* languages.polish: aspell-pl +* languages.portuguese: myspell-pt-pt myspell-pt-br +* languages.serbian: hunspell-sr +* languages.spanish: myspell-es +* languages.swedish: aspell-sv +* languages.tamil: aspell-ta +* languages.russian: myspell-ru +* languages.ukrainian: aspell-uk +* languages.vietnamese: hunspell-vi + +# Development +To contribute, ensure to install the dependencies: +```bash +$ pip install -r requirements.txt +``` + +Install necessary NLTK data: + +``python -m nltk.downloader omw sentiwordnet stopwords wordnet`` + +## Running tests +Make sure you install test dependencies: + +```bash +$ pip install -r test-requirements.txt +``` + +Then run: + +```bash +$ pytest . -vv +``` +# Reporting bugs +To report a bug, please use [Phabricator](https://phabricator.wikimedia.org/maniphest/task/edit/form/1/?projects=revscoring) + +# Authors + * [Aaron Halfaker](http://halfaker.info) + * [Helder](https://github.com/he7d3r) + * [Adam Roses Wight](https://mediawiki.org/wiki/User:Adamw) + * [Amir Sarabadani](https://github.com/Ladsgroup) + + +%prep +%autosetup -n revscoring-2.11.10 + +%build +%py3_build + +%install +%py3_install +install -d -m755 %{buildroot}/%{_pkgdocdir} +if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi +if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi +if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi +if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi +pushd %{buildroot} +if [ -d usr/lib ]; then + find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/lib64 ]; then + find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/bin ]; then + find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst +fi +if [ -d usr/sbin ]; then + find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst +fi +touch doclist.lst +if [ -d usr/share/man ]; then + find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst +fi +popd +mv %{buildroot}/filelist.lst . +mv %{buildroot}/doclist.lst . + +%files -n python3-revscoring -f filelist.lst +%dir %{python3_sitelib}/* + +%files help -f doclist.lst +%{_docdir}/* + +%changelog +* Fri May 05 2023 Python_Bot <Python_Bot@openeuler.org> - 2.11.10-1 +- Package Spec generated @@ -0,0 +1 @@ +4d6730f833b01880097de4b141c833dd revscoring-2.11.10.tar.gz |