Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle large files in SPARQLgraph import tab #473

Open
2 tasks
cuddihyge opened this issue Mar 21, 2023 · 0 comments
Open
2 tasks

Handle large files in SPARQLgraph import tab #473

cuddihyge opened this issue Mar 21, 2023 · 0 comments

Comments

@cuddihyge
Copy link
Collaborator

cuddihyge commented Mar 21, 2023

  • generic large file streaming in SPARQLgraph
  • add place to drop zip files with manifest

When a file is drag-and-dropped to SPARQLgraph for uploading, it reads the whole thing into memory instead of streaming it.
This precludes large imports.
Also precludes using dropping zip files with manifests (which are usually big).

see uploadtab.js function onDropData() which is bound to the dropZones.

It seems like we ought to be able to use FormData something like stackoverflow example to stream a multipart file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant