%global _empty_manifest_terminate_build 0 Name: python-memory-tempfile Version: 2.2.3 Release: 1 Summary: Helper functions to identify and use paths on the OS (Linux-only for now) where RAM-based tempfiles can be created. License: MIT URL: https://github.com/mbello/memory-tempfile Source0: https://mirrors.nju.edu.cn/pypi/web/packages/7c/da/588403f523b1dfc9f70891b21d70f3d0f23b8c56985ca60af6b99c2c9dfc/memory-tempfile-2.2.3.tar.gz BuildArch: noarch %description # Overview Often there is a need to temporarily save a file to 'disk' for the consumption of external tools. Or maybe you can pipe some input info to an external tool but has no way of forcing such external tool to pipe its output straight to your software: **it wants to write a file to disk**. Disk operations are slow and if repeated too often can shorten the lifespan of underlying media. On Linux, most distributions offer a /tmp directory BUT it is usually on physical media. However, modern distributions often offer at east two places where one can safely create temporary files in RAM: /dev/run/, /run/shm and /dev/shm /dev/run/ is ideal for your temporary files. It is writable and readable only by your user. /dev/shm is usually world-readable and world-writable (just like /tmp), it is often used for IPC (inter process communication) and can serve well as a temporary RAM-based tempdir. This module is very simple and tries not to reinvent the wheel. It will check /tmp to see if it in a ramdisk or not. And it will also check if you have other options where to place your temporary files/dirs on a memory-based file system like tmpfs or ramfs. Once you know the suitable path on a memory-based file system where you can have your files, you are well served by python's builtin modules and external packages like pathlib or pyfilesystem2 to move on to do your things. **To know more, I recommend the following links:** https://unix.stackexchange.com/questions/162900/what-is-this-folder-run-user-1000 https://superuser.com/questions/45342/when-should-i-use-dev-shm-and-when-should-i-use-tmp # API This module searches for paths hosted on filesystems of type belonging to MEM_BASED_FS=['tmpfs', 'ramfs'] Paths in SUITABLE_PATHS=['/tmp', '/run/user/{uid}', '/run/shm', '/dev/shm'] are searched and the first path found that exists and is stored on a filesystem whose type belongs to MEM_BASED_FS will be used as the tempdir. If no suitable path is found, then if fallback = True, we will fallback to default tempdir (as determined by tempfile stdlib). If fallback is a path, then we will default to it. If fallback is false, a RunTimeError exception is raised. The MemoryTempfile constructor has arguments that let you change how the algorithm works. You can change the order of paths (with 'preferred_paths'), add new paths to the search (with 'preferred_paths' and/or with 'additional_paths') and you can exclude certain paths from SUITABLE_PATHS (with removed_paths). All paths containing the string {uid} will have it replaced by the user id. You can change the filesystem types you accept (with filesystem_types) and specify whether or not to fallback to a vanilla tempdir as a last resort. Then, all methods available from tempfile stdlib are available through MemoryTempfile. # The constructor: **Here is the list of accepted parameters:** - preferred_paths: list = None - remove_paths: list or bool = None - additional_paths: list = None - filesystem_types: list = None - fallback: str or bool = None The path list that will be searched from first to last item will be constructed using the algorith: paths = preferred_paths + (SUITABLE_PATHS - remove_paths) + additional_paths If remove_paths is boolean 'true', SUITABLE_PATHS will be eliminated, this is a way for you to take complete control of the path list that will be used without relying on this package's hardcoded constants. The only other hardcoded constant MEM_BASED_FS=['tmpfs', 'ramfs'] will not be used at all if you pass your own 'filesystem_types' argument. By the way, if you wish to add other file system types, you must match what Linux uses in /proc/self/mountinfo (at the 9th column). # Requirements - Python 3 - Works only on Linux - Compatible with chroot and/or namespaces, needs access to /proc/self/mountinfo # Usage ## Example 1: from memory_tempfile import MemoryTempfile tempfile = MemoryTempfile() with tempfile.TemporaryFile() as tf: # as usual... ## Example 2: # We now do not want to use /dev/shm or /run/shm and no ramfs paths # If /run/user/{uid} is available, we prefer it to /tmp # And we want to try /var/run as a last resort # If all fails, fallback to platform's tmp dir from memory_tempfile import MemoryTempfile import memory_tempfile # By the way, all paths with string {uid} will have it replaced with the user id tempfile = MemoryTempfile(preferred_paths=['/run/user/{uid}'], remove_paths=['/dev/shm', '/run/shm'], additional_paths=['/var/run'], filesystem_types=['tmpfs'], fallback=True) if tempfile.found_mem_tempdir(): print('We could use any of the followig paths: {}'.format(tempfile.get_usable_mem_tempdir_paths())) print('And we are using now: {}'.format(tempfile.gettempdir())) with tempfile.NamedTemporaryFile() as ntf: # use it as usual... pass %package -n python3-memory-tempfile Summary: Helper functions to identify and use paths on the OS (Linux-only for now) where RAM-based tempfiles can be created. Provides: python-memory-tempfile BuildRequires: python3-devel BuildRequires: python3-setuptools BuildRequires: python3-pip %description -n python3-memory-tempfile # Overview Often there is a need to temporarily save a file to 'disk' for the consumption of external tools. Or maybe you can pipe some input info to an external tool but has no way of forcing such external tool to pipe its output straight to your software: **it wants to write a file to disk**. Disk operations are slow and if repeated too often can shorten the lifespan of underlying media. On Linux, most distributions offer a /tmp directory BUT it is usually on physical media. However, modern distributions often offer at east two places where one can safely create temporary files in RAM: /dev/run/, /run/shm and /dev/shm /dev/run/ is ideal for your temporary files. It is writable and readable only by your user. /dev/shm is usually world-readable and world-writable (just like /tmp), it is often used for IPC (inter process communication) and can serve well as a temporary RAM-based tempdir. This module is very simple and tries not to reinvent the wheel. It will check /tmp to see if it in a ramdisk or not. And it will also check if you have other options where to place your temporary files/dirs on a memory-based file system like tmpfs or ramfs. Once you know the suitable path on a memory-based file system where you can have your files, you are well served by python's builtin modules and external packages like pathlib or pyfilesystem2 to move on to do your things. **To know more, I recommend the following links:** https://unix.stackexchange.com/questions/162900/what-is-this-folder-run-user-1000 https://superuser.com/questions/45342/when-should-i-use-dev-shm-and-when-should-i-use-tmp # API This module searches for paths hosted on filesystems of type belonging to MEM_BASED_FS=['tmpfs', 'ramfs'] Paths in SUITABLE_PATHS=['/tmp', '/run/user/{uid}', '/run/shm', '/dev/shm'] are searched and the first path found that exists and is stored on a filesystem whose type belongs to MEM_BASED_FS will be used as the tempdir. If no suitable path is found, then if fallback = True, we will fallback to default tempdir (as determined by tempfile stdlib). If fallback is a path, then we will default to it. If fallback is false, a RunTimeError exception is raised. The MemoryTempfile constructor has arguments that let you change how the algorithm works. You can change the order of paths (with 'preferred_paths'), add new paths to the search (with 'preferred_paths' and/or with 'additional_paths') and you can exclude certain paths from SUITABLE_PATHS (with removed_paths). All paths containing the string {uid} will have it replaced by the user id. You can change the filesystem types you accept (with filesystem_types) and specify whether or not to fallback to a vanilla tempdir as a last resort. Then, all methods available from tempfile stdlib are available through MemoryTempfile. # The constructor: **Here is the list of accepted parameters:** - preferred_paths: list = None - remove_paths: list or bool = None - additional_paths: list = None - filesystem_types: list = None - fallback: str or bool = None The path list that will be searched from first to last item will be constructed using the algorith: paths = preferred_paths + (SUITABLE_PATHS - remove_paths) + additional_paths If remove_paths is boolean 'true', SUITABLE_PATHS will be eliminated, this is a way for you to take complete control of the path list that will be used without relying on this package's hardcoded constants. The only other hardcoded constant MEM_BASED_FS=['tmpfs', 'ramfs'] will not be used at all if you pass your own 'filesystem_types' argument. By the way, if you wish to add other file system types, you must match what Linux uses in /proc/self/mountinfo (at the 9th column). # Requirements - Python 3 - Works only on Linux - Compatible with chroot and/or namespaces, needs access to /proc/self/mountinfo # Usage ## Example 1: from memory_tempfile import MemoryTempfile tempfile = MemoryTempfile() with tempfile.TemporaryFile() as tf: # as usual... ## Example 2: # We now do not want to use /dev/shm or /run/shm and no ramfs paths # If /run/user/{uid} is available, we prefer it to /tmp # And we want to try /var/run as a last resort # If all fails, fallback to platform's tmp dir from memory_tempfile import MemoryTempfile import memory_tempfile # By the way, all paths with string {uid} will have it replaced with the user id tempfile = MemoryTempfile(preferred_paths=['/run/user/{uid}'], remove_paths=['/dev/shm', '/run/shm'], additional_paths=['/var/run'], filesystem_types=['tmpfs'], fallback=True) if tempfile.found_mem_tempdir(): print('We could use any of the followig paths: {}'.format(tempfile.get_usable_mem_tempdir_paths())) print('And we are using now: {}'.format(tempfile.gettempdir())) with tempfile.NamedTemporaryFile() as ntf: # use it as usual... pass %package help Summary: Development documents and examples for memory-tempfile Provides: python3-memory-tempfile-doc %description help # Overview Often there is a need to temporarily save a file to 'disk' for the consumption of external tools. Or maybe you can pipe some input info to an external tool but has no way of forcing such external tool to pipe its output straight to your software: **it wants to write a file to disk**. Disk operations are slow and if repeated too often can shorten the lifespan of underlying media. On Linux, most distributions offer a /tmp directory BUT it is usually on physical media. However, modern distributions often offer at east two places where one can safely create temporary files in RAM: /dev/run/, /run/shm and /dev/shm /dev/run/ is ideal for your temporary files. It is writable and readable only by your user. /dev/shm is usually world-readable and world-writable (just like /tmp), it is often used for IPC (inter process communication) and can serve well as a temporary RAM-based tempdir. This module is very simple and tries not to reinvent the wheel. It will check /tmp to see if it in a ramdisk or not. And it will also check if you have other options where to place your temporary files/dirs on a memory-based file system like tmpfs or ramfs. Once you know the suitable path on a memory-based file system where you can have your files, you are well served by python's builtin modules and external packages like pathlib or pyfilesystem2 to move on to do your things. **To know more, I recommend the following links:** https://unix.stackexchange.com/questions/162900/what-is-this-folder-run-user-1000 https://superuser.com/questions/45342/when-should-i-use-dev-shm-and-when-should-i-use-tmp # API This module searches for paths hosted on filesystems of type belonging to MEM_BASED_FS=['tmpfs', 'ramfs'] Paths in SUITABLE_PATHS=['/tmp', '/run/user/{uid}', '/run/shm', '/dev/shm'] are searched and the first path found that exists and is stored on a filesystem whose type belongs to MEM_BASED_FS will be used as the tempdir. If no suitable path is found, then if fallback = True, we will fallback to default tempdir (as determined by tempfile stdlib). If fallback is a path, then we will default to it. If fallback is false, a RunTimeError exception is raised. The MemoryTempfile constructor has arguments that let you change how the algorithm works. You can change the order of paths (with 'preferred_paths'), add new paths to the search (with 'preferred_paths' and/or with 'additional_paths') and you can exclude certain paths from SUITABLE_PATHS (with removed_paths). All paths containing the string {uid} will have it replaced by the user id. You can change the filesystem types you accept (with filesystem_types) and specify whether or not to fallback to a vanilla tempdir as a last resort. Then, all methods available from tempfile stdlib are available through MemoryTempfile. # The constructor: **Here is the list of accepted parameters:** - preferred_paths: list = None - remove_paths: list or bool = None - additional_paths: list = None - filesystem_types: list = None - fallback: str or bool = None The path list that will be searched from first to last item will be constructed using the algorith: paths = preferred_paths + (SUITABLE_PATHS - remove_paths) + additional_paths If remove_paths is boolean 'true', SUITABLE_PATHS will be eliminated, this is a way for you to take complete control of the path list that will be used without relying on this package's hardcoded constants. The only other hardcoded constant MEM_BASED_FS=['tmpfs', 'ramfs'] will not be used at all if you pass your own 'filesystem_types' argument. By the way, if you wish to add other file system types, you must match what Linux uses in /proc/self/mountinfo (at the 9th column). # Requirements - Python 3 - Works only on Linux - Compatible with chroot and/or namespaces, needs access to /proc/self/mountinfo # Usage ## Example 1: from memory_tempfile import MemoryTempfile tempfile = MemoryTempfile() with tempfile.TemporaryFile() as tf: # as usual... ## Example 2: # We now do not want to use /dev/shm or /run/shm and no ramfs paths # If /run/user/{uid} is available, we prefer it to /tmp # And we want to try /var/run as a last resort # If all fails, fallback to platform's tmp dir from memory_tempfile import MemoryTempfile import memory_tempfile # By the way, all paths with string {uid} will have it replaced with the user id tempfile = MemoryTempfile(preferred_paths=['/run/user/{uid}'], remove_paths=['/dev/shm', '/run/shm'], additional_paths=['/var/run'], filesystem_types=['tmpfs'], fallback=True) if tempfile.found_mem_tempdir(): print('We could use any of the followig paths: {}'.format(tempfile.get_usable_mem_tempdir_paths())) print('And we are using now: {}'.format(tempfile.gettempdir())) with tempfile.NamedTemporaryFile() as ntf: # use it as usual... pass %prep %autosetup -n memory-tempfile-2.2.3 %build %py3_build %install %py3_install install -d -m755 %{buildroot}/%{_pkgdocdir} if [ -d doc ]; then cp -arf doc %{buildroot}/%{_pkgdocdir}; fi if [ -d docs ]; then cp -arf docs %{buildroot}/%{_pkgdocdir}; fi if [ -d example ]; then cp -arf example %{buildroot}/%{_pkgdocdir}; fi if [ -d examples ]; then cp -arf examples %{buildroot}/%{_pkgdocdir}; fi pushd %{buildroot} if [ -d usr/lib ]; then find usr/lib -type f -printf "/%h/%f\n" >> filelist.lst fi if [ -d usr/lib64 ]; then find usr/lib64 -type f -printf "/%h/%f\n" >> filelist.lst fi if [ -d usr/bin ]; then find usr/bin -type f -printf "/%h/%f\n" >> filelist.lst fi if [ -d usr/sbin ]; then find usr/sbin -type f -printf "/%h/%f\n" >> filelist.lst fi touch doclist.lst if [ -d usr/share/man ]; then find usr/share/man -type f -printf "/%h/%f.gz\n" >> doclist.lst fi popd mv %{buildroot}/filelist.lst . mv %{buildroot}/doclist.lst . %files -n python3-memory-tempfile -f filelist.lst %dir %{python3_sitelib}/* %files help -f doclist.lst %{_docdir}/* %changelog * Wed May 10 2023 Python_Bot - 2.2.3-1 - Package Spec generated