Add Start and End Frame control，works great! #167

TTPlanetPig · 2025-04-20T12:58:38Z

by simply replace the last predicted image by inserted end image. now we can easily control the video to what we want. the Pincer attack from TeneT now is complete.
Thanks my friend "hhy" helped me on the coding as I only have the idea but he is much better on coding!

4.20.-1.mp4

250420_204753_497_5473_10.mp4

FragmentY · 2025-04-20T17:07:40Z

nice work!

luze1011 · 2025-04-20T17:13:38Z

NICE

FurkanGozukara · 2025-04-20T17:38:46Z

Amazing work

I have implemented into my app and working amazing

My app tutorial : https://youtu.be/HwMngohRmHg?si=ImYvFey-R030fbiM

250420_194342_833_7054_seed269740392_37.mp4

kabachuha · 2025-04-20T18:58:27Z

Interpolating between the start and the end conditionings depending on the frame number can be cool as well (actually, such interpolation is a unique feature of next frame prediction models), it will require some caching though, but it's for the future maybe :)

Anyway, amazing work, works like a charm! 🚀

rkfg · 2025-04-20T19:32:43Z

I tried doing the same and if the images are different enough the effect is bad. All segments but the first would animate the last frame, and the first segment would quickly turn from the first frame to last. Maybe I did something wrong, can you try with a longer video like 10-15 seconds?

zadokov · 2025-04-20T20:17:20Z

It could have been great but for now this only works for the first 1 second (all the transformation is done on 1st second and all the other seconds are just static).

lllyasviel · 2025-04-20T20:48:06Z

I think maybe I should create a repo like FramePackSoftware or FramePackAdvanced or some similar names as a independent repo to merge and implement ideas. This main repo is a research repo and need to be made simple. I will probably move this PR. Let me think how to process it

zadokov · 2025-04-20T21:06:31Z

I think maybe I should create a repo like FramePackSoftware or FramePackAdvanced or some similar names as a independent repo to merge and implement ideas. This main repo is a research repo and need to be made simple. I will probably move this PR. Let me think how to process it

@lllyasviel - All Issues and PRs here seem related to the software/studio - Maybe create a new repo for the Research?

rkfg · 2025-04-20T21:38:59Z

It could have been great but for now this only works for the first 1 second (all the transformation is done on 1st second and all the other seconds are just static).

That was my experience as well, I described my findings here: #32 (comment)

spawner1145 · 2025-04-21T00:02:52Z

Amazing work

I have implemented into my app and working amazing

My app tutorial : https://youtu.be/HwMngohRmHg?si=ImYvFey-R030fbiM

250420_194342_833_7054_seed269740392_37.mp4

I have seen you in many issues and you are always trying to copy others' open source ideas to make money,don't you feel ashamed?

TTPlanetPig · 2025-04-21T00:13:23Z

I tried doing the same and if the images are different enough the effect is bad. All segments but the first would animate the last frame, and the first segment would quickly turn from the first frame to last. Maybe I did something wrong, can you try with a longer video like 10-15 seconds?

for long video, you will need more middle frame or change the schedule method. still under study...

GJohGJ · 2025-04-21T11:01:50Z

Nice work!! If we could use controlnet also, this make a difference in guiding from a existing video

H4sh3 · 2025-04-21T12:31:10Z

demo_gradio.py

        total_generated_latent_frames = 0

-        latent_paddings = reversed(range(total_latent_sections))
+        # 将迭代器转换为列表


English comment would be great

中文评论才是精华

andorxornot · 2025-04-21T15:36:05Z

it would be cool to set keyframes for any frame, not just start/end.

Eikwang · 2025-04-22T07:00:12Z

效果非常好!

deniss-muhla · 2025-04-23T13:19:13Z

it would be cool to set keyframes for any frame, not just start/end.

If we have start and end frames when we can just split video generation in sections...
Actually it's even better to have a separate generation for each part as it will be easier to describe motion.

IMHO the next step will be batch generation and joining.
For now I join them in the video editor.

poprice29 · 2025-04-25T05:12:47Z

Amazing work

I have implemented into my app and working amazing

My app tutorial : https://youtu.be/HwMngohRmHg?si=ImYvFey-R030fbiM

250420_194342_833_7054_seed269740392_37.mp4

You are literally saying you implemented someone else's work and are essentially selling it. Have you no shame?

mocat15 · 2025-04-25T23:05:06Z

Great job, @TTPlanetPig and hhy! It worked great for me. One issue that I had was that the size of the output videos was smaller than the i2v default output files with the same settings. I turned down the MPEG compression to zero, which made me feel a bit better.

Thank you, @lllyasviel, for Framepack!

CKVNZ · 2025-04-27T18:10:42Z

Sorry im a new guy here. How do i implement this first-last frame into my already existing Framepack?
The current Framepack consume too much space with duplicate output & temp folder in C drive.

julia-0105 · 2025-04-28T02:47:36Z

My first and last frame sampling stops after 2-3 times, and no video is generated. Is there anyone who has the same problem as me? How can I solve it?

soliderwang · 2025-04-29T15:45:07Z

That's great! It would be perfect if it supported 20 series graphics cards

IckeBins67 · 2025-04-29T18:27:11Z

How to implement this? I do git pull, but it says already up to date.

uselessgithub · 2025-04-29T19:55:24Z

How to implement this? I do git pull, but it says already up to date.

You have to pull this specific PR 167, something like this over your local pull:
git fetch origin pull/167/head:pr-167
git checkout pr-167

used some code from those PR, thanks to their respective authors : lllyasviel#167 lllyasviel#178 lllyasviel#158

jkpwed · 2025-05-03T13:44:56Z

I don't know python but I can see this opens the doors to Slow Motion, and Frame Interpolation (in between frames) converting 30 fps video to 60 (or higher).

tin2tin · 2025-05-03T22:30:48Z

Has anyone succeeded in using video as more start-frames and end-frames? If possible, FramePack could be used for video inpainting with motion trajectories intact.

* add transformer * add pipeline * fixes * make fix-copies * update * add flux mu shift * update example snippet * debug * cleanup * batch_size=1 optimization * add pipeline test * fix for model cpu offloading' * add last_image support; credits: lllyasviel/FramePack#167 * update example with flf2v * update penguin url * fix test * address review comment: #11428 (comment) * address review comment: #11428 (comment) * Update src/diffusers/pipelines/hunyuan_video/pipeline_hunyuan_video_framepack.py --------- Co-authored-by: Linoy Tsaban <[email protected]>

SimmC2 · 2025-05-07T02:12:34Z

did have F1 ver?

wozniakty · 2025-05-09T05:56:12Z

Tried this out and the video started immediately with the endframe?

IckeBins67 · 2025-05-10T10:02:08Z

works fantastic! thanks! i would have loved to integrate the slider for the resolution here, but i have no idea how.

spawner1145 · 2025-05-10T11:38:19Z

works fantastic! thanks! i would have loved to integrate the slider for the resolution here, but i have no idea how.

Maybe you can have a look at my code? I've integrated some of the most commonly used functions.
https://github.com/spawner1145/sd-webui-framepack.git

IckeBins67 · 2025-05-10T17:05:57Z

works fantastic! thanks! i would have loved to integrate the slider for the resolution here, but i have no idea how.

Maybe you can have a look at my code? I've integrated some of the most commonly used functions. https://github.com/spawner1145/sd-webui-framepack.git

Thanks, but my Chinese is just as bad as my programming skills. Do you have a step by step guide?

spawner1145 · 2025-05-10T17:18:16Z

works fantastic! thanks! i would have loved to integrate the slider for the resolution here, but i have no idea how.

Maybe you can have a look at my code? I've integrated some of the most commonly used functions. https://github.com/spawner1145/sd-webui-framepack.git

Thanks, but my Chinese is just as bad as my programming skills. Do you have a step by step guide?

I've already created a bilingual version of the README.

QuadTrillionaire · 2025-05-12T19:24:20Z

Hello everyone, I need help please.

I have used the install package of the original framepack, which works great, as well as the F1 add on.
My issue is that I tried to install the video input add on, but I get a frustrating error:

" File "C:\framepack_cu126_torch26\webui\demo_gradio_f1_video.py", line 16, in
import decord
ModuleNotFoundError: No module named 'decord' "

I then used pip install decord within the main directory where framepack was installed and ran into this error:

"PS C:\framepack_cu126_torch26> pip install decord
Requirement already satisfied: decord in c:\python312\lib\site-packages (0.6.0)
Requirement already satisfied: numpy>=1.14.0 in c:\python312\lib\site-packages (from decord) (2.2.2) "

Can someone please guide me out of this situation?

rafa11rodrigues · 2025-09-16T22:18:38Z

I think maybe I should create a repo like FramePackSoftware or FramePackAdvanced or some similar names as a independent repo to merge and implement ideas. This main repo is a research repo and need to be made simple. I will probably move this PR. Let me think how to process it

Hi
Did you create this repo? If not, do you plan to merge these extensions into the main branch?
I know we can pull from the specific PRs, but it would be very nice to have these features "natively" from the main official repo, or from a repo maintained and reviewed by the owner of the project

TTPlanetPig added 3 commits April 20, 2025 20:03

add start and end frame control function

d5d4d4a

update with start and end frame control

1c0cb5c

update for start and end frame control

6084231

kabachuha mentioned this pull request Apr 20, 2025

Add end frame setting support kijai/ComfyUI-FramePackWrapper#5

Merged

CheNing233 mentioned this pull request Apr 20, 2025

Add end frame control support kijai/ComfyUI-FramePackWrapper#6

Closed

H4sh3 reviewed Apr 21, 2025

View reviewed changes

FlowDownTheRiver mentioned this pull request Apr 22, 2025

xformers,flashattention,sage attention 1 click installer bat file for windows + mod #138

Closed

uselessgithub mentioned this pull request Apr 23, 2025

Feature enhancement: IMG to video to IMG #272

Closed

ali0une mentioned this pull request Apr 25, 2025

Linux Gradio has not the first and last frame generation function? when I operate demo_gradio.py I just find i2v? #322

Open

ghost approved these changes Apr 26, 2025

View reviewed changes

a-l-e-x-d-s-9 mentioned this pull request Apr 26, 2025

QueueItUp for Framepack mod adds queueing, batching, prompt saving, and many ui tweeks #218

Closed

LIQUIDMIND111 mentioned this pull request Apr 27, 2025

yesterday was normal, but today I can't get in. #378

Closed

MrKuenning mentioned this pull request Apr 27, 2025

Add Start and End Frame control FP-Studio/framepack-studio#37

Closed

a-r-r-o-w added a commit to huggingface/diffusers that referenced this pull request Apr 29, 2025

add last_image support; credits: lllyasviel/FramePack#167

0070763

a-r-r-o-w mentioned this pull request Apr 29, 2025

Hunyuan Video Framepack huggingface/diffusers#11428

Merged

3 tasks

uselessgithub added a commit to uselessgithub/FramePackPlus that referenced this pull request Apr 29, 2025

Added end frame, more stats, image metadata saving and loading...

5e14b91

used some code from those PR, thanks to their respective authors : lllyasviel#167 lllyasviel#178 lllyasviel#158

jkpwed mentioned this pull request Apr 30, 2025

GTX 1070 support, 10XX series support #277

Open

zadokov mentioned this pull request May 1, 2025

Testing of the latest commit: 4781156bc87599dc07c926034a6a3cb89b3e2bae FP-Studio/framepack-studio#47

Closed

FernandoConti mentioned this pull request May 20, 2025

Would it be possible to add end frame like in original FramePack/167? FP-Studio/framepack-studio#123

Closed

littilesix approved these changes May 24, 2025

View reviewed changes

Fabrice-TIERCELIN mentioned this pull request Jul 3, 2025

FramePack with Video Input (Video Extension) + End Frame #491

Open

Add Start and End Frame control，works great! #167

Are you sure you want to change the base?

Add Start and End Frame control，works great! #167

Conversation

TTPlanetPig commented Apr 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

FragmentY commented Apr 20, 2025

Uh oh!

luze1011 commented Apr 20, 2025

Uh oh!

FurkanGozukara commented Apr 20, 2025

Uh oh!

kabachuha commented Apr 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

rkfg commented Apr 20, 2025

Uh oh!

zadokov commented Apr 20, 2025

Uh oh!

lllyasviel commented Apr 20, 2025

Uh oh!

zadokov commented Apr 20, 2025

Uh oh!

rkfg commented Apr 20, 2025

Uh oh!

spawner1145 commented Apr 21, 2025

Uh oh!

TTPlanetPig commented Apr 21, 2025

Uh oh!

GJohGJ commented Apr 21, 2025

Uh oh!

H4sh3 Apr 21, 2025

Choose a reason for hiding this comment

Uh oh!

berryyan Apr 22, 2025

Choose a reason for hiding this comment

Uh oh!

duongtungls Apr 28, 2025

Choose a reason for hiding this comment

Uh oh!

andorxornot commented Apr 21, 2025

Uh oh!

Eikwang commented Apr 22, 2025

Uh oh!

deniss-muhla commented Apr 23, 2025

Uh oh!

poprice29 commented Apr 25, 2025

Uh oh!

mocat15 commented Apr 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

CKVNZ commented Apr 27, 2025

Uh oh!

julia-0105 commented Apr 28, 2025

Uh oh!

soliderwang commented Apr 29, 2025

Uh oh!

IckeBins67 commented Apr 29, 2025

Uh oh!

uselessgithub commented Apr 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jkpwed commented May 3, 2025

Uh oh!

tin2tin commented May 3, 2025

Uh oh!

SimmC2 commented May 7, 2025

Uh oh!

wozniakty commented May 9, 2025

Uh oh!

IckeBins67 commented May 10, 2025

Uh oh!

spawner1145 commented May 10, 2025

Uh oh!

IckeBins67 commented May 10, 2025

Uh oh!

spawner1145 commented May 10, 2025

Uh oh!

QuadTrillionaire commented May 12, 2025

TTPlanetPig commented Apr 20, 2025 •

edited

Loading

kabachuha commented Apr 20, 2025 •

edited

Loading

mocat15 commented Apr 25, 2025 •

edited

Loading

uselessgithub commented Apr 29, 2025 •

edited

Loading