Ibis - Now flying on Snowflake – Ibis

[giscus[bot]]

Ibis - Now flying on Snowflake – Ibis

the portable Python dataframe library

https://ibis-project.org/posts/run-on-snowflake/

[ShawnStrasser]

When I try this, I can run my function locally and it works:

ibis_sproc(session)

But if I try calling it to run from snowflake:

session.call("THE_IBIS_SPROC")

AttributeError: module 'ibis' has no attribute 'snowflake'

[ShawnStrasser]

So I went to the unit tests to see how the connection is made there, and it turned out to be different than what was shown in the article. (ibis/backends/snowflake/tests/test_udf.py)

Connecting like this works:

def test_ibis_inside_snowpark(snowpark_session, execute_as):
    import snowflake.snowpark as sp

    def ibis_sproc(session):
        import ibis.backends.snowflake

        con = ibis.backends.snowflake.Backend.from_connection(session)

This works but gives a warning: FutureWarning: Backend.from_snowpark is deprecated as of v10.0; use from_connection instead

I'm really excited that it is working now, I'll be able to convert my Ibis code into Snowflake functions now! But Snowflake has been such a pain to use Python packages not already installed.