Combine LLaMA with Image Segmentation using SAM 2

[farukalamai]

No description provided.

[ariG23498]

Hi @farukalamai

We appreciate your eagerness to work on this repository and start with your contribution. It would be great to add a description of what you think would be doing.

As I understand from the title, you would like to add Llama with SAM, but a more detailed description would help us brain storm together and make this more impactful!

[Sakalya100]

Hi @farukalamai
I really love the idea of this issue and would like to contribute to it. Are you currently working on this issue? If yes can you share what progress is already made and what exactly are you planning to include in the notebook.

Let me know and I would be happy to contribute!

[Sakalya100]

Hi @ariG23498

I am not sure if @farukalamai is working on it. I have some initial idea and would like to start working on it.

This is my idea for a notebook that combines LLaMA and SAM 2

1. Integrates LLaMA and SAM 2 for natural language-guided image segmentation
2. Create a step by step process from loading relevant models, integrating and doing the final image-segmentation task
3. Include visualization of segmentation results at the end

Let me know your thoughts!