Problem using AWS S3 for storage

I am trying to set up shopware 6 with AWS S3 storage as suggested here: Shopware 6: Using external storage

I am on a ubuntu18.04 AMI with apache2. I set up a private and a public bucket with the IAM keypair and permissions and I have tried both the url for the public bucket and a cloudfront url for the cdn (the item at the end of the link above). I also enable rewrite in apache2. 

The installation and set up go through. When I look at the storefront page, everything is messed up and out of place.  

Has anyone else experienced this issue?