Skip to content

TESTING.md

Latest commit

 

History

History
208 lines (170 loc) · 6.11 KB

TESTING.md

File metadata and controls

208 lines (170 loc) · 6.11 KB

Testing Guide for Exact Ratio Distribution

This document provides comprehensive test cases for verifying the exact ratio distribution feature for coupons and refunds in batch mode.

Prerequisites

  • WordPress installation with WooCommerce
  • WC Smooth Generator plugin installed
  • WP-CLI access
  • Some products already generated (run wp wc generate products 50 if needed)

Test Cases

1. Basic Coupon Ratio Tests

Test 1.1: Exact 50% coupon ratio

wp wc generate orders 100 --coupon-ratio=0.5

Expected Result: Exactly 50 orders with coupons

Verification:

# Count orders with coupons via database
wp db query "SELECT COUNT(DISTINCT order_id) FROM wp_woocommerce_order_items WHERE order_item_type = 'coupon'"

Test 1.2: Edge case - 0.0 ratio (no coupons)

wp wc generate orders 50 --coupon-ratio=0.0

Expected Result: 0 orders with coupons

Test 1.3: Edge case - 1.0 ratio (all coupons)

wp wc generate orders 50 --coupon-ratio=1.0

Expected Result: Exactly 50 orders with coupons

Test 1.4: Odd number rounding

wp wc generate orders 11 --coupon-ratio=0.5

Expected Result: Exactly 6 orders with coupons (5.5 rounds to 6)

2. Basic Refund Ratio Tests

Test 2.1: Exact 40% refund ratio with distribution

wp wc generate orders 100 --status=completed --refund-ratio=0.4

Expected Result:

  • Total: 40 refunds
  • Distribution: ~20 full, ~10 single partial, ~10 multi-partial

Verification:

# Count total refunds
wp db query "SELECT COUNT(*) FROM wp_posts WHERE post_type = 'shop_order_refund'"

# Count full refunds (orders with status 'refunded')
wp db query "SELECT COUNT(*) FROM wp_posts WHERE post_type = 'shop_order' AND post_status = 'wc-refunded'"

Test 2.2: Edge case - 0.0 ratio (no refunds)

wp wc generate orders 50 --status=completed --refund-ratio=0.0

Expected Result: 0 refunds

Test 2.3: Edge case - 1.0 ratio (all refunds)

wp wc generate orders 50 --status=completed --refund-ratio=1.0

Expected Result: Exactly 50 refunds (distributed 50/25/25)

Test 2.4: Odd number rounding for refunds

wp wc generate orders 11 --status=completed --refund-ratio=0.4

Expected Result:

  • Total: 4 refunds (rounded)
  • Distribution: ~2 full, ~1 partial, ~1 multi (remainder)

3. Parameter Precedence Tests

Test 3.1: Legacy --coupons flag

wp wc generate orders 20 --coupons

Expected Result: All 20 orders have coupons (legacy behavior preserved)

Test 3.2: Coupon ratio without legacy flag

wp wc generate orders 100 --coupon-ratio=0.3

Expected Result: Exactly 30 orders with coupons

Test 3.3: Both flags (ratio should be ignored when legacy flag present)

wp wc generate orders 100 --coupons --coupon-ratio=0.3

Expected Result: All 100 orders have coupons (--coupons takes precedence)

4. Single Order Generation (Probabilistic Fallback)

Test 4.1: Single order with coupon ratio should use probabilistic

# Run multiple times to verify probabilistic behavior
wp wc generate orders 1 --coupon-ratio=0.5
wp wc generate orders 1 --coupon-ratio=0.5
wp wc generate orders 1 --coupon-ratio=0.5

Expected Result: Approximately 50% of single orders will have coupons (varies each run)

5. Refund Distribution Verification

Test 5.1: Verify 50/25/25 refund split

# Generate orders and check distribution
wp wc generate orders 200 --status=completed --refund-ratio=0.5

Expected Result:

  • Total refunds: 100
  • Full refunds (~50): Orders with status "refunded"
  • Single partial (~25): Orders with 1 refund, status still "completed"
  • Multi-partial (~25): Orders with 2 refunds, status still "completed"

Manual Verification:

  1. Check a sample of fully refunded orders in WP Admin
  2. Check a sample of partially refunded orders
  3. Count number of refund entries per order

6. Combined Parameters

Test 6.1: Date range + coupon ratio + refund ratio

wp wc generate orders 100 --date-start=2024-01-01 --date-end=2024-12-31 --status=completed --coupon-ratio=0.4 --refund-ratio=0.3

Expected Result:

  • Orders spread across date range
  • Exactly 40 orders with coupons
  • Exactly 30 orders with refunds (distributed 50/25/25)

7. Failed Orders Edge Case

Test 7.1: Verify failed orders don't affect count

# If products are missing or invalid, some orders may fail
wp wc generate orders 100 --coupon-ratio=0.5

Expected Result:

  • Count only successful orders
  • If only 95 orders succeed, there should be exactly 47-48 with coupons (based on 95, not 100)

Verification Queries

Count Orders with Coupons

wp db query "SELECT COUNT(DISTINCT order_id) FROM wp_woocommerce_order_items WHERE order_item_type = 'coupon'"

Count All Refunds

wp db query "SELECT COUNT(*) FROM wp_posts WHERE post_type = 'shop_order_refund'"

Count Full Refunds (Orders with 'refunded' status)

wp db query "SELECT COUNT(*) FROM wp_posts WHERE post_type = 'shop_order' AND post_status = 'wc-refunded'"

Count Partial Refunds

wp db query "
SELECT COUNT(*) as partial_refund_orders
FROM (
    SELECT p.ID, COUNT(r.ID) as refund_count
    FROM wp_posts p
    LEFT JOIN wp_posts r ON r.post_parent = p.ID AND r.post_type = 'shop_order_refund'
    WHERE p.post_type = 'shop_order' AND p.post_status = 'wc-completed'
    GROUP BY p.ID
    HAVING refund_count > 0
) as refunded_completed
"

Count Multi-Partial Refunds (2 refunds on same order)

wp db query "
SELECT COUNT(*) as multi_partial_orders
FROM (
    SELECT p.ID, COUNT(r.ID) as refund_count
    FROM wp_posts p
    LEFT JOIN wp_posts r ON r.post_parent = p.ID AND r.post_type = 'shop_order_refund'
    WHERE p.post_type = 'shop_order'
    GROUP BY p.ID
    HAVING refund_count = 2
) as multi_refunded
"

Notes

  • All exact ratio tests assume successful order generation
  • Exact ratio distribution uses O(1) memory via dynamic counters (selection without replacement algorithm)
  • Works for any batch size without memory constraints
  • Ratios are rounded using PHP's round() function for odd numbers