[RELAX][BYOC] OpenCLML offload support for Relax

[srkreddy1238]

This brings in OpenCLML offloading via BYOC path with available operators in Relax.
Adds Codegen tests for Mainline CI.
Also brings in pipeline definitions for Adreno targets.

[srkreddy1238]

We do codegen check here (JSON comparison).

[srkreddy1238]

Mainline will not have rpc, Hence we don't proceed beyond this point

[srkreddy1238]

@Hzfengsy for the OptimizeBatchnorm pass

DecomposeOpsForInference couldn't help here as it results Conv2D+few elem_wise ops.

OptimizeBatchnorm does folds batchnorm attributes into Conv2D weight and Bias, which we can offload as Fused Conv2D+Bias op of CLML.

[Hzfengsy]

Thanks for pinging me. @srkreddy1238

OptimizeBatchnorm does folds batchnorm attributes into Conv2D weight and Bias, which we can offload as Fused Conv2D+Bias op of CLML.

IIUC it works as a CLML-specific pass. If so, could you please move it under adreno or clml folders, or at least add comments saying that it works only for CLML.

[srkreddy1238]

IIUC it works as a CLML-specific pass.

This is not CLML specific. Can be used for fusing Conv2D+BN -> Conv2D (Updated weight, bias) for inference case.

[tqchen]

This is not CLML specific. Can be used for fusing Conv2D+BN -> Conv2D (Updated weight, bias) for inference case..

Note on this pass. This was an optimization can indeed can apply more broadly. One note is that this optimization is a special case of FoldScaleAxis optimization that folds scale into weights, so we want to add a comment here that we can replace by general FoldScaleAxis in future, cc @Hzfengsy @srkreddy1238

[tqchen]

Thanks @srkreddy1238 for great effort, glad to see the new target aware pipeline helps to simplify the flow here. also cc @MasterJH5574

[tqchen]

Thanks @srkreddy1238 this is merged!

[srkreddy1238]

The codegen tests are added in unity->gpu. But I see this CI pipeline only builds GPU but doesn't run tests. Is this expected to be enabled soon ?

[tqchen]

https://github.com/apache/tvm/blob/main/ci/jenkins/unity_jenkinsfile.groovy#L356 the build stage of unity pipeline does run relax tests.

We can also followup to fold unity pipeline into the normal gpu pipeline