How to set-up a Django project with django-storages and Amazon S3, but with different folders for static files and media files? How to set-up a Django project with django-storages and Amazon S3, but with different folders for static files and media files? django django

How to set-up a Django project with django-storages and Amazon S3, but with different folders for static files and media files?


I think the following should work, and be simpler than Mandx's method, although it's very similar:

Create a s3utils.py file:

from storages.backends.s3boto import S3BotoStorageStaticRootS3BotoStorage = lambda: S3BotoStorage(location='static')MediaRootS3BotoStorage  = lambda: S3BotoStorage(location='media')

Then in your settings.py:

DEFAULT_FILE_STORAGE = 'myproject.s3utils.MediaRootS3BotoStorage'STATICFILES_STORAGE = 'myproject.s3utils.StaticRootS3BotoStorage'

A different but related example (that I've actually tested) can be seen in the two example_ files here.


I'm currently using this code in a separated s3utils module:

from django.core.exceptions import SuspiciousOperationfrom django.utils.encoding import force_unicodefrom storages.backends.s3boto import S3BotoStoragedef safe_join(base, *paths):    """    A version of django.utils._os.safe_join for S3 paths.    Joins one or more path components to the base path component intelligently.    Returns a normalized version of the final path.    The final path must be located inside of the base path component (otherwise    a ValueError is raised).    Paths outside the base path indicate a possible security sensitive operation.    """    from urlparse import urljoin    base_path = force_unicode(base)    paths = map(lambda p: force_unicode(p), paths)    final_path = urljoin(base_path + ("/" if not base_path.endswith("/") else ""), *paths)    # Ensure final_path starts with base_path and that the next character after    # the final path is '/' (or nothing, in which case final_path must be    # equal to base_path).    base_path_len = len(base_path) - 1    if not final_path.startswith(base_path) \       or final_path[base_path_len:base_path_len + 1] not in ('', '/'):        raise ValueError('the joined path is located outside of the base path'                         ' component')    return final_pathclass StaticRootS3BotoStorage(S3BotoStorage):    def __init__(self, *args, **kwargs):        super(StaticRootS3BotoStorage, self).__init__(*args, **kwargs)        self.location = kwargs.get('location', '')        self.location = 'static/' + self.location.lstrip('/')    def _normalize_name(self, name):        try:            return safe_join(self.location, name).lstrip('/')        except ValueError:            raise SuspiciousOperation("Attempted access to '%s' denied." % name)class MediaRootS3BotoStorage(S3BotoStorage):    def __init__(self, *args, **kwargs):        super(MediaRootS3BotoStorage, self).__init__(*args, **kwargs)        self.location = kwargs.get('location', '')        self.location = 'media/' + self.location.lstrip('/')    def _normalize_name(self, name):        try:            return safe_join(self.location, name).lstrip('/')        except ValueError:            raise SuspiciousOperation("Attempted access to '%s' denied." % name)

Then, in my settings module:

DEFAULT_FILE_STORAGE = 'myproyect.s3utils.MediaRootS3BotoStorage'STATICFILES_STORAGE = 'myproyect.s3utils.StaticRootS3BotoStorage'

I got to redefine the _normalize_name() private method to use a "fixed" version of the safe_join() function, since the original code is giving me SuspiciousOperation exceptions for legal paths.

I'm posting this for consideration, if anyone can give a better answer or improve this one, it will be very welcome.



File: PROJECT_NAME/custom_storages.py

from django.conf import settingsfrom storages.backends.s3boto import S3BotoStorageclass StaticStorage(S3BotoStorage):    location = settings.STATICFILES_LOCATIONclass MediaStorage(S3BotoStorage):    location = settings.MEDIAFILES_LOCATION

File: PROJECT_NAME/settings.py

STATICFILES_LOCATION = 'static'MEDIAFILES_LOCATION = 'media'if not DEBUG:    STATICFILES_STORAGE = 'PROJECT_NAME.custom_storages.StaticStorage'    DEFAULT_FILE_STORAGE = 'PROJECT_NAME.custom_storages.MediaStorage'    AWS_ACCESS_KEY_ID = 'KEY_XXXXXXX'    AWS_SECRET_ACCESS_KEY = 'SECRET_XXXXXXXXX'    AWS_STORAGE_BUCKET_NAME = 'BUCKET_NAME'    AWS_HEADERS = {'Cache-Control': 'max-age=86400',}    AWS_QUERYSTRING_AUTH = False

And run: python manage.py collectstatic