The personal website of Scott W Harden
Source code for Compress and Store Files in Python
title: Compress and Store Files in Python
date: 2008-11-24 17:48:16
  - python
  - old

# Compress Strings and Store to Files in Python

 __While writing code for my graduate research thesis__ I came across the need to lightly compress a huge and complex variable (a massive 3D data array) and store it in a text file for later retrieval.  I decided to use the [zlib]( compression library because it's open source and works pretty much on every platform.  I ran into a snag for a while though, because whenever I loaded data from a text file it wouldn't properly decompress.  I fixed this problem by adding the "rb" to the open line, forcing python to read the text file as binary data rather than ascii data.  Below is my code, written in two functions to save/load compressed string data to/from files in Python.

import zlib  
def saveIt(data,fname):  
def openIt(fname,evaluate=True):  
    if evaluate: data=eval(data)  
    return data  

__Oh yeah, don't forget__ the evaluate option in the openIt function.  If set to True (default), the returned variable will be an evaluated object.  For example, `[[1,2],[3,4]]` will be returned as an actual 2D list, not just a string.  How convenient is that?
Newer: Fixing Slow Internet in Ubuntu
Older: Run Ubuntu Live CD From a USB Drive
All Blog Posts