Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

All configuration must be available via OPTIONS in Spark SQL's CREATE TEMPORARY TABLE #16

Open
spirom opened this issue May 10, 2015 · 0 comments
Assignees
Milestone

Comments

@spirom
Copy link
Owner

spirom commented May 10, 2015

Much of NSMC's configuration uses SparkContext properties, but these don't work over, say, a JDBC connector when the context is not easily accessible, and in anyc ase they make it hard to use a diverse set of MongoDB instances and even collections.

Spark SQL integration needs to be extended to allow all of this configuration to be passed into the OPTIONS clause of CREATE TEMPORARY TABLE, etc, one a per-collection basis.

@spirom spirom self-assigned this May 10, 2015
@spirom spirom added this to the v0.6.0 milestone May 10, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant