Commit 0950492
Arunodoy18
Fix triggeringFrequency documentation and validation for STORAGE_API_AT_LEAST_ONCE
- Updated JavaDoc to reflect that triggeringFrequency applies to FILE_LOADS,
STORAGE_WRITE_API, and STORAGE_API_AT_LEAST_ONCE methods
- Fixed validation logic in expand() to require triggeringFrequency for
STORAGE_API_AT_LEAST_ONCE when writing unbounded PCollections
- Removed conflicting warning that incorrectly stated STORAGE_API_AT_LEAST_ONCE
ignores triggeringFrequency
- Added comprehensive test cases to verify proper validation behavior:
* Test failure when triggeringFrequency is missing for unbounded collections
* Test success when triggeringFrequency is provided for unbounded collections
* Test success for bounded collections without triggeringFrequency requirement
- Updated error messages to include all three supported methods
This ensures consistent behavior across all BigQuery write methods that support
triggered writes for unbounded collections.1 parent bf37c0f commit 0950492
2 files changed
Lines changed: 79 additions & 14 deletions
File tree
- sdks/java/io/google-cloud-platform/src
- main/java/org/apache/beam/sdk/io/gcp/bigquery
- test/java/org/apache/beam/sdk/io/gcp/bigquery
Lines changed: 11 additions & 13 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3330 | 3330 | | |
3331 | 3331 | | |
3332 | 3332 | | |
3333 | | - | |
3334 | | - | |
| 3333 | + | |
| 3334 | + | |
| 3335 | + | |
3335 | 3336 | | |
3336 | 3337 | | |
3337 | 3338 | | |
| |||
3736 | 3737 | | |
3737 | 3738 | | |
3738 | 3739 | | |
3739 | | - | |
| 3740 | + | |
| 3741 | + | |
| 3742 | + | |
3740 | 3743 | | |
3741 | | - | |
| 3744 | + | |
| 3745 | + | |
3742 | 3746 | | |
3743 | 3747 | | |
3744 | 3748 | | |
3745 | 3749 | | |
3746 | | - | |
| 3750 | + | |
3747 | 3751 | | |
3748 | 3752 | | |
3749 | 3753 | | |
3750 | 3754 | | |
3751 | | - | |
| 3755 | + | |
3752 | 3756 | | |
3753 | 3757 | | |
3754 | 3758 | | |
| |||
3757 | 3761 | | |
3758 | 3762 | | |
3759 | 3763 | | |
3760 | | - | |
3761 | | - | |
3762 | | - | |
3763 | | - | |
3764 | | - | |
3765 | | - | |
3766 | | - | |
| 3764 | + | |
3767 | 3765 | | |
3768 | 3766 | | |
3769 | 3767 | | |
| |||
Lines changed: 68 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2632 | 2632 | | |
2633 | 2633 | | |
2634 | 2634 | | |
2635 | | - | |
| 2635 | + | |
| 2636 | + | |
2636 | 2637 | | |
2637 | 2638 | | |
2638 | 2639 | | |
| |||
2646 | 2647 | | |
2647 | 2648 | | |
2648 | 2649 | | |
| 2650 | + | |
| 2651 | + | |
| 2652 | + | |
| 2653 | + | |
| 2654 | + | |
| 2655 | + | |
| 2656 | + | |
| 2657 | + | |
| 2658 | + | |
| 2659 | + | |
| 2660 | + | |
| 2661 | + | |
| 2662 | + | |
| 2663 | + | |
| 2664 | + | |
| 2665 | + | |
| 2666 | + | |
| 2667 | + | |
| 2668 | + | |
| 2669 | + | |
| 2670 | + | |
| 2671 | + | |
| 2672 | + | |
| 2673 | + | |
| 2674 | + | |
| 2675 | + | |
| 2676 | + | |
| 2677 | + | |
| 2678 | + | |
| 2679 | + | |
| 2680 | + | |
| 2681 | + | |
| 2682 | + | |
| 2683 | + | |
| 2684 | + | |
| 2685 | + | |
| 2686 | + | |
| 2687 | + | |
| 2688 | + | |
| 2689 | + | |
| 2690 | + | |
| 2691 | + | |
| 2692 | + | |
| 2693 | + | |
| 2694 | + | |
| 2695 | + | |
| 2696 | + | |
| 2697 | + | |
| 2698 | + | |
| 2699 | + | |
| 2700 | + | |
| 2701 | + | |
| 2702 | + | |
| 2703 | + | |
| 2704 | + | |
| 2705 | + | |
| 2706 | + | |
| 2707 | + | |
| 2708 | + | |
| 2709 | + | |
| 2710 | + | |
| 2711 | + | |
| 2712 | + | |
| 2713 | + | |
| 2714 | + | |
| 2715 | + | |
2649 | 2716 | | |
2650 | 2717 | | |
2651 | 2718 | | |
| |||
0 commit comments