-
Notifications
You must be signed in to change notification settings - Fork 19
Open
Labels
dependencyIssue arises because of a dependencyIssue arises because of a dependencyhelp wantedExtra attention is neededExtra attention is neededtritoninvolves triton kernelsinvolves triton kernels
Description
We currently have unsloth kernels in the FOAK plugin:
However, Liger is coming up strong with a lot of great developments, like AMD support. So perhaps we should also integrate liger kernels, and allow users the ability to switch to them in the configs.
Things to consider
- Since liger is released on PyPI and is strongly supported, perhaps we should pull it in as a package dep, instead of copying the code (understand that code copying is currently the strategy of Introduce Liger Fused Cross Entropy Kernel to FOAK Plugin Β #76 )
Metadata
Metadata
Assignees
Labels
dependencyIssue arises because of a dependencyIssue arises because of a dependencyhelp wantedExtra attention is neededExtra attention is neededtritoninvolves triton kernelsinvolves triton kernels