Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider offering gzipped Full JSON as an export type #439

Open
kerchner opened this issue Sep 13, 2016 · 2 comments
Open

Consider offering gzipped Full JSON as an export type #439

kerchner opened this issue Sep 13, 2016 · 2 comments
Assignees
Milestone

Comments

@kerchner
Copy link
Member

kerchner commented Sep 13, 2016

Compression on Full JSON is roughly a 1:8 ratio, so on a large extract (such as an extract from Sample Stream), providing the export gzipped could make transfer much easier. Consider applying gzip as an option (perhaps a checkbox?) that could apply to any export type.

This came up in the context of preparing for Prof. Broniatowski's class, EMSE 4197, as we would like to offer students the option to export data from the Twitter samplestream; these exports can be quite large in their raw, non-zipped, form.

@lwrubel
Copy link
Collaborator

lwrubel commented May 11, 2017

Discuss with @justinlittman whether to gzip all the files together or gzip individual files. Priority is full JSON export type.

@lwrubel lwrubel modified the milestones: 1.9, Backlog May 11, 2017
@justinlittman justinlittman modified the milestones: 1.9, Backlog Jun 19, 2017
@lwrubel
Copy link
Collaborator

lwrubel commented Jun 22, 2017

For this ticket, gzip individual files, not the whole set of export files.

@lwrubel lwrubel modified the milestones: 1.10, Backlog Jun 22, 2017
@justinlittman justinlittman modified the milestones: Backlog, 1.10 Aug 2, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants