📖 [Story] Converters optimization #3733
Description
TL;DR
Based on the PR #3732, converters need to be optimized to meet the requirement of converter unit tests that Torch-TRT is expected to have the same num of ILayer types as ONNX-TRT.
I have run all of the converter unit tests and the full output result is attached in converter_tests.log. All problematic converters need to be fixed.
Goal(s)
Modify the problematic converters to pass converter unit tests.
Tasks
### Tasks
Additional context
A glance of the result is as follows. The full output result is attached in converter_tests.log
$ python -m pytest ./ 2>&1 | tee converter_tests.log
============================= test session starts ==============================
platform linux -- Python 3.13.2, pytest-8.3.5, pluggy-1.5.0
rootdir: /home/zewenl/Documents/pytorch/TensorRT
configfile: pyproject.toml
plugins: xdist-3.6.1, typeguard-4.3.0
collected 1897 items
test_abs_aten.py ....... [ 0%]
test_acos_aten.py .......... [ 0%]
test_acosh_aten.py .......... [ 1%]
test_adaptive_avgpool_aten.py FFFFFFFFFFFFFFFFFFFFFFFF.F.FFFFFFFFFFFFFFF [ 3%]
FFFF [ 3%]
test_add_aten.py FFFF...F [ 4%]
test_addmm_aten.py ......FF.FF [ 4%]
test_amax_aten.py .....FFFFF.....FFFFFF...... [ 6%]
test_amin_aten.py .....FFFFF.....FFFFFF...... [ 7%]
test_any.py FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF [ 10%]
test_arange_aten.py FFFFFFFFFFF [ 10%]
test_argmax_aten.py FFFFFFFFFFFFFFFFFFFF [ 11%]
test_argmin_aten.py FFFFFFFFFFFFFFFFFFFF [ 12%]
test_as_strided_aten.py FFFFFFFFF [ 13%]
test_asin_aten.py .......... [ 13%]
test_asinh_aten.py .......... [ 14%]
test_atan2_aten.py FFFFFFFFFFFFFFFFFFFFFFFFssss [ 15%]
test_atan_aten.py .......... [ 16%]
test_atanh_aten.py .......... [ 17%]
test_attention.py FFF [ 17%]
test_batch_norm_aten.py F.FF..F..F. [ 17%]
test_binary_ops_aten.py .FFFFFFF...FFFFF..FFFFFFFFFF...FFFFF.....FFFFF.. [ 20%]
...FFFFF..FFFFFFFF...FFFFF..FFFFFFFF [ 22%]
test_bitwise_and_aten.py .FFFF..FFF.. [ 22%]
test_bitwise_not_aten.py .... [ 23%]
test_bitwise_or_aten.py FFFF..FFF.. [ 23%]
test_bitwise_xor_aten.py FFFF..FFF.. [ 24%]
test_bmm.py ... [ 24%]
test_casts.py FFF..FF [ 24%]
test_cat_aten.py ........ [ 25%]
test_cdist_aten.py FFFFFFFFFFFFFFFFFFFFFFFFFFF [ 26%]
test_ceil_aten.py ....FFF.. [ 27%]
test_clamp_aten.py FFFFF.....FFFF [ 27%]
test_clip_aten.py FFFFFFFFFFFF [ 28%]
test_composite_aten_op.py ....... [ 28%]
test_converter_utils.py .................. [ 29%]
test_convolution_aten.py FFFFFFFFFFFF...................... [ 31%]
test_copy_aten.py FFFFFFFF [ 31%]
test_cos_aten.py .......... [ 32%]
test_cosh_aten.py .......... [ 32%]
test_cumsum_aten.py FFFFFFFFFFFFFFFFFFFF [ 34%]
test_deconvolution_aten.py FFFFFFFFFFFFFF........................... [ 36%]
test_diagonal_aten.py FFFFFFFFFFFFFFF [ 37%]
test_div_aten.py FFFFF.. [ 37%]
test_dropout_aten.py FFFF.... [ 37%]
test_elu_aten.py ... [ 37%]
test_embedding_aten.py .... [ 38%]
test_embedding_bag_aten.py FFFFFFFFFFFFFFFFF.. [ 39%]
test_empty_aten.py ....... [ 39%]
test_eq_aten.py FFFFFFFFFF......FFFFFF [ 40%]
test_erf_aten.py ......... [ 41%]
test_evaluators.py s [ 41%]
test_exp_aten.py ........... [ 41%]
test_expand_aten.py ...FFFFFFFF [ 42%]
test_expm1_aten.py FFFFFFFFFFF... [ 43%]
test_flip_aten.py FFFFFFFFFFFFFFFFF [ 44%]
test_floor_aten.py .......FFF [ 44%]
test_floor_div_aten.py FFFFFFFF [ 44%]
test_full_aten.py FFFFFF.. [ 45%]
test_gather_aten.py ........ [ 45%]
test_ge_aten.py .FFF..FFFFF [ 46%]
test_gelu_aten.py FFFFFF [ 46%]
test_grid_aten.py ......................................... [ 48%]
test_group_norm_aten.py FFFFFFF [ 49%]
test_gt_aten.py .FFF..FFFFF [ 49%]
test_hard_sigmoid_aten.py .... [ 50%]
test_hardtanh_aten.py ... [ 50%]
test_index_aten.py FFFFFFFFFFFFFF [ 50%]
test_index_put_aten.py FFFFFFFFFFFFFFFFFFFFF [ 52%]
test_index_select_aten.py FFFFFFFF... [ 52%]
test_isinf_aten.py ...... [ 52%]
test_isnan_aten.py FFFFFFFF [ 53%]
test_layer_norm_aten.py FFFFFFFFF [ 53%]
test_le_aten.py FFFFFF......FFFFFF [ 54%]
test_leaky_relu_aten.py ... [ 54%]
test_linear_aten.py FFF.. [ 55%]
test_log10.py FFFFF...FFF [ 55%]
test_log1p.py FFFFFFFFFFF [ 56%]
test_log2.py FFFFF...FFF [ 56%]
test_log_aten.py ........... [ 57%]
test_logical_and_aten.py FFF. [ 57%]
test_logical_not_aten.py ..FFFFFFFFF [ 58%]
test_logical_or_aten.py FFFFF [ 58%]
test_logical_xor_aten.py FFFFF [ 58%]
test_lt_aten.py FFFFFF......FFFFFF [ 59%]
test_matmul_aten.py .......FF..FFFFF.......FFFF [ 61%]
test_max_aten.py ...............FFF [ 62%]
test_maximum_aten.py .... [ 62%]
test_mean_aten.py ....FF [ 62%]
test_min_aten.py ...............FFF [ 63%]
test_minimum_aten.py .... [ 63%]
test_mul_aten.py FFFF.. [ 64%]
test_ne_aten.py FFFFFF......FFFFFF [ 65%]
test_neg_aten.py ......FF [ 65%]
test_nonzero_aten.py ................ [ 66%]
test_pad_aten.py FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF [ 69%]
FFFFFFFFF [ 69%]
test_pdist_aten.py FFFFFFFFFFFFFF [ 70%]
test_permutation_aten.py ...... [ 70%]
test_pixel_shuffle_aten.py FFFFFF [ 71%]
test_pixel_unshuffle_aten.py FFFF [ 71%]
test_pool_aten.py FFFFFF............F....FFFFFF............ [ 73%]
test_pow_aten.py F.FFFF.. [ 73%]
test_prelu_aten.py FFF [ 74%]
test_prod_aten.py ................ [ 74%]
test_rand_aten.py ......... [ 75%]
test_recip_aten.py ........... [ 75%]
test_relu_aten.py ... [ 76%]
test_remainder_aten.py FFFFFFFFF [ 76%]
test_reshape_aten.py ssssssss [ 77%]
test_resize_aten.py ....................................... [ 79%]
test_roll_aten.py FFFFFFFFFFFFFFFFFFFFFFFFFF [ 80%]
test_round_aten.py .......FFF [ 80%]
test_rsqrt_aten.py FFFFFF [ 81%]
test_scalar_tensor_aten.py ...................... [ 82%]
test_scatter_aten.py FFFFFFFFFFFFFFFFFF [ 83%]
test_select_aten.py FFFFFF [ 83%]
test_sigmoid_aten.py .... [ 83%]
test_sign_aten.py .......... [ 84%]
test_sin_aten.py .......... [ 84%]
test_sinh_aten.py .......... [ 85%]
test_slice_aten.py FFFFFFFFFFFFFFFFFFFFFFF [ 86%]
test_softmax_aten.py FFFFFF [ 87%]
test_softplus_aten.py FFF [ 87%]
test_sort_aten.py FFFFFFFFFF [ 87%]
test_split_aten.py .....FFF. [ 88%]
test_sqrt_aten.py ............... [ 88%]
test_squeeze_aten.py FFFFFFFF [ 89%]
test_sub_aten.py F...FFFF...F [ 90%]
test_sum_aten.py .........................FFFFFFFFFF [ 91%]
test_sym_not_aten.py FFFFF [ 92%]
test_sym_size.py FF [ 92%]
test_tan_aten.py .......... [ 92%]
test_tanh_aten.py ... [ 92%]
test_tile_aten.py ..................FFFFFFFFFFFFFFFFFF [ 94%]
test_topk_aten.py FFFFFFFFF [ 95%]
test_trunc_aten.py FFFFFFFFFF [ 95%]
test_unsqueeze_aten.py .....................FF. [ 97%]
test_upsample_aten.py ....FF......FF..FFFFFFFF..F...F...F.....FF.. [ 99%]
test_where_aten.py .........FF [100%]