%global _empty_manifest_terminate_build 0 Name: python-pillaralgos Version: 1.0.20 Release: 1 Summary: Algorithms for Pillar. Currently includes "mini" algorithms, nothing too sophisticated. License: GPL-3.0-or-later URL: https://pypi.org/project/pillaralgos/ Source0: https://mirrors.aliyun.com/pypi/web/packages/09/8e/3d8ca1a5428f62b388dfc7efca9b732653fd1b51f877e28d04c3564cb107/pillaralgos-1.0.20.tar.gz BuildArch: noarch Requires: python3-pandas Requires: python3-numpy %description NOTE: This readme is just a quick reference. For more details include todo, near/medium/long term goals please see our GitHub page. # Table of Contents 1. [Use](#use) 1. [Input variables](#input-variables) 2. [Output variables](#output-variables) 2. [Background](#background) 1. [Algorithms](#algorithms) 1. [Timeit Results](#timeit-results) 3. [Build and Publis](#build) 4. [Changelog](#changelog) # Use To use any of the algorithms just import as needed with `from pillaralgos import algo1`, and then `algo1(data, min_=2, save_json=False)`. ## Input variables ``` save_json: bool True if want to save results as json to exports folder data: list min_: int Approximate number of minutes each clip should be sort_by: str For algo1 ONLY 'rel': "number of chatters at timestamp"/"number of chatters at that hour" 'abs': "number of chatters at timestamp"/"total number of chatters in stream" goal: str For algo3_5 ONLY 'num_words': sum of the number of words in each chat message 'num_emo': sum of the number of emoticons in each chat message 'num_words_emo': sum of the number of words + emoticons in each chat message min_words:int For algo3_0 ONLY When filtering chunks to top users, at least how many words the top user should send ``` ## Output variables * All algorithms will return a `result_json`, list of dictionaries in the format of `{start:seconds, end:seconds}` where `seconds` is seconds elapsed since start of the stream. List is ordered from predicted best to worst timestamps. * All algorithms can save the returned list as a .json if `save_json=True` is passed in. # Background Pillar is creating an innovative way to automatically select and splice clips from Twitch videos for streamers. This repo is focusing on the algorithm aspect. Three main algorithms are being tested. ## Algorithms 1. [Algorithm 1](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_1.ipynb): Find the best moments in clips based on where the most users participated. Most is defined as the *ratio of unique users* during a 2 min section to unique users for the entire session. 1. [Algorithm 2](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_2.ipynb) Find the best moments in clips based on when rate of messages per user peaked. This involves answering the question "at which 2 min segment do the most users send the most messages?". If users X, Y, and Z all send 60% of their messages at timestamp range delta, then that timestamp might qualify as a "best moment" 1. __NOTE__: Currently answers the question "at which 2 min segment do users send the most messages fastest" 1. [Algorithm 3 (WIP)](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_3.ipynb) Weigh each user by their chat rate, account age, etc. Heavier users predicted to chat more often at "best moment" timestamps 1. __STATUS__: current weight determined by (`num_words_of_user`/`num_words_of_top_user`) 1. [Algorithm 3.5](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_3.5.ipynb) Finds the best moments in clips based on most number of words/emojis/both used in chat ### Timeit results Results as of `April 13, 2021 18:31 EST` run on `big_df` with 80841 rows, 10 columns. | algo1 | algo2 | algo3_0 | algo3_5 | |--------|--------------|---------|---------| |2.2 sec | 1 min 23 sec |28.1 sec | 16.3 sec| # Build To build and publish this package we are using the [poetry](https://python-poetry.org/) python packager. It takes care of some background stuff that led to [mistakes in the past](https://github.com/pillargg/twitch_chat_analysis/issues/8). Folder structure: ``` |-- dev_tools |-- pillaralgos_dev |-- __init__.py |-- dev_helpers.py # aws connection, file retrieval script |-- sanity_checks.py # placeholder |-- README.md |-- pyproject.toml |-- prod |-- pillaralgos # <---- note that poetry didn't require an additional subfolder |-- helpers |-- __init__.py |-- data_handler.py |-- emoji_getter.py |-- __init__.py # must include version number |-- algoXX.py # all algorithms in separate files |-- brain.py |-- LICENSE |-- README.md |-- pyproject.toml # must include version number |-- reinstall_pill.sh # quick script to uninstall local pillaralgos, build and install new one ``` To publish just run the `poetry publish --build` command after update version numbers as needed. # Changelog * New algorithms * Algo3.6: rank timestamps by emoji:user ratio * Algo4: rank timestamps by compound score from SentimentAnalyzer * Unit testing for algo 3.6 %package -n python3-pillaralgos Summary: Algorithms for Pillar. Currently includes "mini" algorithms, nothing too sophisticated. Provides: python-pillaralgos BuildRequires: python3-devel BuildRequires: python3-setuptools BuildRequires: python3-pip %description -n python3-pillaralgos NOTE: This readme is just a quick reference. For more details include todo, near/medium/long term goals please see our GitHub page. # Table of Contents 1. [Use](#use) 1. [Input variables](#input-variables) 2. [Output variables](#output-variables) 2. [Background](#background) 1. [Algorithms](#algorithms) 1. [Timeit Results](#timeit-results) 3. [Build and Publis](#build) 4. [Changelog](#changelog) # Use To use any of the algorithms just import as needed with `from pillaralgos import algo1`, and then `algo1(data, min_=2, save_json=False)`. ## Input variables ``` save_json: bool True if want to save results as json to exports folder data: list min_: int Approximate number of minutes each clip should be sort_by: str For algo1 ONLY 'rel': "number of chatters at timestamp"/"number of chatters at that hour" 'abs': "number of chatters at timestamp"/"total number of chatters in stream" goal: str For algo3_5 ONLY 'num_words': sum of the number of words in each chat message 'num_emo': sum of the number of emoticons in each chat message 'num_words_emo': sum of the number of words + emoticons in each chat message min_words:int For algo3_0 ONLY When filtering chunks to top users, at least how many words the top user should send ``` ## Output variables * All algorithms will return a `result_json`, list of dictionaries in the format of `{start:seconds, end:seconds}` where `seconds` is seconds elapsed since start of the stream. List is ordered from predicted best to worst timestamps. * All algorithms can save the returned list as a .json if `save_json=True` is passed in. # Background Pillar is creating an innovative way to automatically select and splice clips from Twitch videos for streamers. This repo is focusing on the algorithm aspect. Three main algorithms are being tested. ## Algorithms 1. [Algorithm 1](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_1.ipynb): Find the best moments in clips based on where the most users participated. Most is defined as the *ratio of unique users* during a 2 min section to unique users for the entire session. 1. [Algorithm 2](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_2.ipynb) Find the best moments in clips based on when rate of messages per user peaked. This involves answering the question "at which 2 min segment do the most users send the most messages?". If users X, Y, and Z all send 60% of their messages at timestamp range delta, then that timestamp might qualify as a "best moment" 1. __NOTE__: Currently answers the question "at which 2 min segment do users send the most messages fastest" 1. [Algorithm 3 (WIP)](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_3.ipynb) Weigh each user by their chat rate, account age, etc. Heavier users predicted to chat more often at "best moment" timestamps 1. __STATUS__: current weight determined by (`num_words_of_user`/`num_words_of_top_user`) 1. [Algorithm 3.5](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_3.5.ipynb) Finds the best moments in clips based on most number of words/emojis/both used in chat ### Timeit results Results as of `April 13, 2021 18:31 EST` run on `big_df` with 80841 rows, 10 columns. | algo1 | algo2 | algo3_0 | algo3_5 | |--------|--------------|---------|---------| |2.2 sec | 1 min 23 sec |28.1 sec | 16.3 sec| # Build To build and publish this package we are using the [poetry](https://python-poetry.org/) python packager. It takes care of some background stuff that led to [mistakes in the past](https://github.com/pillargg/twitch_chat_analysis/issues/8). Folder structure: ``` |-- dev_tools |-- pillaralgos_dev |-- __init__.py |-- dev_helpers.py # aws connection, file retrieval script |-- sanity_checks.py # placeholder |-- README.md |-- pyproject.toml |-- prod |-- pillaralgos # <---- note that poetry didn't require an additional subfolder |-- helpers |-- __init__.py |-- data_handler.py |-- emoji_getter.py |-- __init__.py # must include version number |-- algoXX.py # all algorithms in separate files |-- brain.py |-- LICENSE |-- README.md |-- pyproject.toml # must include version number |-- reinstall_pill.sh # quick script to uninstall local pillaralgos, build and install new one ``` To publish just run the `poetry publish --build` command after update version numbers as needed. # Changelog * New algorithms * Algo3.6: rank timestamps by emoji:user ratio * Algo4: rank timestamps by compound score from SentimentAnalyzer * Unit testing for algo 3.6 %package help Summary: Development documents and examples for pillaralgos Provides: python3-pillaralgos-doc %description help NOTE: This readme is just a quick reference. For more details include todo, near/medium/long term goals please see our GitHub page. # Table of Contents 1. [Use](#use) 1. [Input variables](#input-variables) 2. [Output variables](#output-variables) 2. [Background](#background) 1. [Algorithms](#algorithms) 1. [Timeit Results](#timeit-results) 3. [Build and Publis](#build) 4. [Changelog](#changelog) # Use To use any of the algorithms just import as needed with `from pillaralgos import algo1`, and then `algo1(data, min_=2, save_json=False)`. ## Input variables ``` save_json: bool True if want to save results as json to exports folder data: list min_: int Approximate number of minutes each clip should be sort_by: str For algo1 ONLY 'rel': "number of chatters at timestamp"/"number of chatters at that hour" 'abs': "number of chatters at timestamp"/"total number of chatters in stream" goal: str For algo3_5 ONLY 'num_words': sum of the number of words in each chat message 'num_emo': sum of the number of emoticons in each chat message 'num_words_emo': sum of the number of words + emoticons in each chat message min_words:int For algo3_0 ONLY When filtering chunks to top users, at least how many words the top user should send ``` ## Output variables * All algorithms will return a `result_json`, list of dictionaries in the format of `{start:seconds, end:seconds}` where `seconds` is seconds elapsed since start of the stream. List is ordered from predicted best to worst timestamps. * All algorithms can save the returned list as a .json if `save_json=True` is passed in. # Background Pillar is creating an innovative way to automatically select and splice clips from Twitch videos for streamers. This repo is focusing on the algorithm aspect. Three main algorithms are being tested. ## Algorithms 1. [Algorithm 1](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_1.ipynb): Find the best moments in clips based on where the most users participated. Most is defined as the *ratio of unique users* during a 2 min section to unique users for the entire session. 1. [Algorithm 2](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_2.ipynb) Find the best moments in clips based on when rate of messages per user peaked. This involves answering the question "at which 2 min segment do the most users send the most messages?". If users X, Y, and Z all send 60% of their messages at timestamp range delta, then that timestamp might qualify as a "best moment" 1. __NOTE__: Currently answers the question "at which 2 min segment do users send the most messages fastest" 1. [Algorithm 3 (WIP)](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_3.ipynb) Weigh each user by their chat rate, account age, etc. Heavier users predicted to chat more often at "best moment" timestamps 1. __STATUS__: current weight determined by (`num_words_of_user`/`num_words_of_top_user`) 1. [Algorithm 3.5](https://github.com/pomkos/twitch_chat_analysis/blob/reorganize_repo/algorithm_3.5.ipynb) Finds the best moments in clips based on most number of words/emojis/both used in chat ### Timeit results Results as of `April 13, 2021 18:31 EST` run on `big_df` with 80841 rows, 10 columns. | algo1 | algo2 | algo3_0 | algo3_5 | |--------|--------------|---------|---------| |2.2 sec | 1 min 23 sec |28.1 sec | 16.3 sec| # Build To build and publish this package we are using the [poetry](https://python-poetry.org/) python packager. It takes care of some background stuff that led to [mistakes in the past](https://github.com/pillargg/twitch_chat_analysis/issues/8). Folder structure: ``` |-- dev_tools |-- pillaralgos_dev |-- __init__.py |-- dev_helpers.py # aws connection, file retrieval script |-- sanity_checks.py # placeholder |-- README.md |-- pyproject.toml |-- prod |-- pillaralgos # <---- note that poetry didn't require an additional subfolder |-- helpers |-- __init__.py |-- data_handler.py |-- emoji_getter.py |-- __init__.py # must include version number |-- algoXX.py # all algorithms in separate files |-- brain.py |-- LICENSE |-- README.md |-- pyproject.toml # must include version number |-- reinstall_pill.sh # quick script to uninstall local pillaralgos, build and install new one ``` To publish just run the `poetry publish --build` command after update version numbers as needed. # Changelog * New algorithms * Algo3.6: rank timestamps by emoji:user ratio * Algo4: rank timestamps by compound score from SentimentAnalyzer * Unit testing for algo 3.6 %prep %autosetup -n pillaralgos-1.0.20 %build %py3_build %install %py3_install install -d -m755 %{buildroot}/%{_pkgdocdir} if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi pushd %{buildroot} if [ -d usr/lib ]; then find usr/lib -type f -printf "\"/%h/%f\"\n" >> filelist.lst fi if [ -d usr/lib64 ]; then find usr/lib64 -type f -printf "\"/%h/%f\"\n" >> filelist.lst fi if [ -d usr/bin ]; then find usr/bin -type f -printf "\"/%h/%f\"\n" >> filelist.lst fi if [ -d usr/sbin ]; then find usr/sbin -type f -printf "\"/%h/%f\"\n" >> filelist.lst fi touch doclist.lst if [ -d usr/share/man ]; then find usr/share/man -type f -printf "\"/%h/%f.gz\"\n" >> doclist.lst fi popd mv %{buildroot}/filelist.lst . mv %{buildroot}/doclist.lst . %files -n python3-pillaralgos -f filelist.lst %dir %{python3_sitelib}/* %files help -f doclist.lst %{_docdir}/* %changelog * Tue Jun 20 2023 Python_Bot - 1.0.20-1 - Package Spec generated