Describe what you'd like to see added to EXO.
I'm going to use an explanation my configuration as an example (however there is no reason others couldn't find use in this feature). I currently have 7 Proxmox servers in my cluster. 3 of them are just dedicated CephFS pools for HDD storage, the other for host my VMs and LXCs. I have 4 LXCs, one Unprivileged LXC on each of the 4 non storage nodes. Each have RDMA passthrough to my Mellanox 100GB NIC, and each have GPU passthrough to an Ada Nvidia GPU. I have a bind mount to a shared folder from my CephFS nodes, each cache is not shared and remains in the LXC.
The issue I'm running into is it does not like the storage being shared and is preventing model downloads from being completed/causing some of the EXO nodes to crash.
What I would like to request is some support for share storage with some kind of toggle (and maybe auto set a local cache so setups with different storage solutions from mine can use them). I want to play with large models, and I don't want 4 copies of the same model with the price of storage the way it is right now.
Describe what you'd like to see added to EXO.
I'm going to use an explanation my configuration as an example (however there is no reason others couldn't find use in this feature). I currently have 7 Proxmox servers in my cluster. 3 of them are just dedicated CephFS pools for HDD storage, the other for host my VMs and LXCs. I have 4 LXCs, one Unprivileged LXC on each of the 4 non storage nodes. Each have RDMA passthrough to my Mellanox 100GB NIC, and each have GPU passthrough to an Ada Nvidia GPU. I have a bind mount to a shared folder from my CephFS nodes, each cache is not shared and remains in the LXC.
The issue I'm running into is it does not like the storage being shared and is preventing model downloads from being completed/causing some of the EXO nodes to crash.
What I would like to request is some support for share storage with some kind of toggle (and maybe auto set a local cache so setups with different storage solutions from mine can use them). I want to play with large models, and I don't want 4 copies of the same model with the price of storage the way it is right now.