wr.athena.to_iceberg deletes existent tabel when param mode == "overwrite" #2789
gabrieloqm
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello, hope you are all doing great!
When using the method wr.athena.to_iceberg (in awswrangler version 3.7.2), I realize that when assigning mode = 'overwrite' when calling this method, the specified athena table in the specified database gets deleted first, and there is a need to specify a value to the table_location param so that the table gets created again (although this didn't seem to be necessary when reading the docs). Is there a way to overwrite the files in the inputed table without deleting the table at all (only its previous data)?
And if there is not, is there a way to save the files with overwrite mode in iceberg Athena table with another method? I have tried with to_parquet. It indeed creates a file on the desired path, but it does not populate the table right away.
Thank you in advance!
Beta Was this translation helpful? Give feedback.
All reactions