add ansi-safe casting

[yankomo]

Description

When using Databricks serverless compute, ANSI mode is on by default, which enforces stricter standards on some SQL commands, one of which is stricter casting behavior.

This PR

• updates Spark Expectations internal code to use a cast function that is safe for ANSI mode usage
• updates documentation to guide the user to provide ANSI-compliant expectations if they use serverless
• updates error messages to be more informative when these errors are encountered

Related Issue

#304

Motivation and Context

See above. Enables casting in Spark Expectations to be ANSI-compliant.

How Has This Been Tested?

Added new unit tests & ran

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

• My code follows the code style of this project.
• My change requires a change to the documentation.
• I have updated the documentation accordingly.
• I have read the CONTRIBUTING document.
• I have added tests to cover my changes.
• All new and existing tests passed.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 98.57%. Comparing base (22d5ef8) to head (0acdd5f).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #303      +/-   ##
==========================================
+ Coverage   98.56%   98.57%   +0.01%     
==========================================
  Files          32       32              
  Lines        3547     3579      +32     
==========================================
+ Hits         3496     3528      +32     
  Misses         51       51              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[asingamaneni]

cursor_pull_request_303_review.md

Please look at the issues pointed and fix them

[yankomo]

cursor_pull_request_303_review.md

Please look at the issues pointed and fix them

Thanks for this review, Ashok! I looked over the feedback and I think that it can all be added to a follow-up improvement ticket. Although some of the callouts are described as bugs I'd argue that nothing is actually broken with the code the PR introduces, just perhaps not as pretty or clear as it could be. But please let me know if there are specific points in your feedback that you'd say absolutely need to be addressed for this PR and could not be added as a follow-up.

[AmaniG77]

LGTM

[yankomo]

cursor_pull_request_303_review.md

Please look at the issues pointed and fix them

I made a new issue to track this! #306