Skip to content

Add support for dropping invalid rows for pyspark backend - #1639

Open
zaheerabbas21 wants to merge 6 commits into
unionai-oss:mainfrom
zaheerabbas21:feature/pyspark-full-table-validation
Open

zaheerabbas21 wants to merge 6 commits into
unionai-oss:mainfrom
zaheerabbas21:feature/pyspark-full-table-validation

Merge branch 'main' into feature/pyspark-full-table-validation

86a34a4
Select commit
Loading
Failed to load commit list.
Codecov / codecov/project failed Jun 23, 2026 in 1s

74.00% (-20.28%) compared to 812b2a8

View this Pull Request on Codecov

74.00% (-20.28%) compared to 812b2a8

Details

Codecov Report

❌ Patch coverage is 5.63380% with 67 lines in your changes missing coverage. Please review.
✅ Project coverage is 74.00%. Comparing base (812b2a8) to head (86a34a4).
⚠️ Report is 562 commits behind head on main.

Files with missing lines Patch % Lines
pandera/backends/pyspark/builtin_checks.py 0.00% 57 Missing ⚠️
pandera/backends/pyspark/utils.py 0.00% 9 Missing ⚠️
pandera/config.py 80.00% 1 Missing ⚠️

❗ There is a different number of reports uploaded between BASE (812b2a8) and HEAD (86a34a4). Click for more details.

HEAD has 7 uploads less than BASE
Flag BASE (812b2a8) HEAD (86a34a4)
48 41
Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1639       +/-   ##
===========================================
- Coverage   94.28%   74.00%   -20.28%     
===========================================
  Files          91      120       +29     
  Lines        7013     9190     +2177     
===========================================
+ Hits         6612     6801      +189     
- Misses        401     2389     +1988     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.