Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

content downloaded in gzip format #82

Open
tuananh opened this issue Jul 17, 2023 · 2 comments
Open

content downloaded in gzip format #82

tuananh opened this issue Jul 17, 2023 · 2 comments

Comments

@tuananh
Copy link

tuananh commented Jul 17, 2023

i think the offending commit is this 8e3a72e

it looks like it download content as gzip but leaving it as is.

we rollback to previous version and it works.

the data in my case is .html file, raw text. it's getting downloaded as gzip content which can't be display with nginx.

my expectation: s3sync should keep the file as is.

To do this, maybe we can do additional head request to check the content type and see if decompression is required?

@cl-bvl
Copy link
Collaborator

cl-bvl commented Jul 17, 2023

Hello. You are right, it's a bug. I will fix it soon.

@cl-bvl
Copy link
Collaborator

cl-bvl commented Jan 25, 2024

Hello.
Added option --server-gzip as workaround for this.

It's look like different providers/servers implement different GZIP logic.
AWS S3 send compressed only files uploaded with Content-Encoding: gzip.
But probably your servers sends all files compressed with gzip. Probably it's not a S3 server configuration, but your reverse proxy configuration, between client and server.

What s3 server (provider) are you using?
If it's self hosted do you have reverse proxies (like nginx)? If yes, can you please show proxy gzip configuration?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants