decompress_file_iter ( "/path/to/input.lz", word_size = 4 ): values = numpy. Read and decompress a file one chunk at a time, and ensure that each chunk contains a number of bytes that is a multiple of word_size (useful to parse numpy arrays with a known dtype): import lzip import numpy for chunk in lzip. decompress_file_iter ( "/path/to/input.lz" ): # chunk is a bytes object Read and decompress a file one chunk at a time (useful for large files): import lzip for chunk in lzip. Read and decompress a file to an in-memory buffer: import lzip buffer = lzip. Lzip can use different compression levels. compress_to_file ( "/path/to/output.lz", values. close ()Ĭompress a Numpy array and write the result to a file: import lzip import numpy values = numpy. FileEncoder ( "/path/to/output.lz" ) encoder. Use FileEncoder without context management ( with): import lzip encoder = lzip. FileEncoder ( "/path/to/output.lz" ) as encoder : encoder. compress_to_file ( "/path/to/output.lz", b "data to compress" )Ĭompress multiple chunks and write the result to a single file (useful to avoid large in-memory buffers): import lzip with lzip.
#Lzip atf2 install#
pip3 install lzipĬompress an in-memory buffer and write it to a file: import lzip lzip. URLs can be used as well to download, decompress and process the chunks of a remote Lzip archive in one go. Decoding and encoding can be performed in chunks, enabling the decompression, processing and compression of files that do not fit in RAM. This package is compatible with arbitrary byte sequences but provides features to facilitate interoperability with Numpy's frombuffer and tobytes functions. Lzip is a Python wrapper for lzlib ( ) to encode and decode Lzip archives ( ).
0 kommentar(er)
