{
"$type": "site.standard.document",
"bskyPostRef": {
"cid": "bafyreifo5vuvxxhmvxlv6clofdl2si5hdtgfys63qebeyxtbzocjhgmaom",
"uri": "at://did:plc:pgryn3ephfd2xgft23qokfzt/app.bsky.feed.post/3moyhbbhaxsa2"
},
"path": "/t/nvidia-driver-update-reactor-node/176221#post_18",
"publishedAt": "2026-06-23T20:56:26.000Z",
"site": "https://discuss.huggingface.co",
"tags": [
"ComfyUI Wan FLF2V example",
"ComfyUI Wan2.2 docs",
"Wan2.1 repo",
"(click for more details)",
"ReActor repo"
],
"textContent": "In my previous reply, I mainly talked about the general recommended flow, but if I narrow it down specifically to improving the video side, I think it would look something like this:\n\n* * *\n\n## Short version\n\nFor your current stage and an 8GB VRAM setup, I would **not** jump sideways into a larger “perfect identity / perfect audio / perfect control” workflow yet.\n\nI would first stabilize the smallest video route:\n\n\n no F2F for now\n → very short I2V / TI2V\n → static camera\n → one small action\n → stronger preservation prompt\n → several seeds\n → pick the best face-stable result\n → repair only the bad parts later\n\n\nThe main change is this:\n\n> I would stop treating F2F as a face-consistency tool.\n> I would treat it as an endpoint-transition tool.\n\nYour own test is probably the most useful evidence here: when you removed the F2F / last-frame part, the lighting bump disappeared. So I would not put F2F back into the main route until the simpler video path is stable.\n\n* * *\n\n## Why I would avoid F2F as the main fix for now\n\nThe way I understand your result is:\n\nSetup | What you wanted | What likely happened\n---|---|---\nFirst frame = image A | preserve the character |\nLast frame = same image A | force the clip to return to the same identity |\nShort action prompt | “char1 looks at char2” |\nActual result | Wan generated an intermediate path, then returned to A |\nVisible symptom | lighting / color / exposure changed in the middle |\n\nSo the model may not be interpreting this as:\n\n\n keep the same face and lighting for the whole clip\n\n\nIt may be closer to:\n\n\n start here, invent a middle, and return to the endpoint\n\n\nThat is useful for transitions, but not always useful for “same person, same lighting, tiny motion.”\n\nThis also matches how the ComfyUI FLF docs describe the workflow: first/last frames define the video boundaries, and the model fills the intermediate transition/dynamic change:\nComfyUI Wan FLF2V example\n\nSo I would classify the tools like this:\n\nGoal | Better first tool\n---|---\nMake one image slightly alive | normal I2V / TI2V\nMake a clear A-to-B transition | F2F / FLF\nMake a loop | generate a good short clip first, then loop/edit later\nRepair one bad area/frame | I2I / inpaint / frame repair\nStronger video repair/control | VACE or control workflow later\nStrong identity-specific workflow | Stand-In / LoRA / identity workflow later\n\nSo, for now, I would keep F2F out of the main path.\n\n* * *\n\n## 8GB VRAM: what seems realistic\n\nOn 8GB, I would think about the options like this:\n\nRoute | 8GB practicality | My opinion for your current stage\n---|---|---\nVery short I2V / TI2V | Good | Best next step\nWan2.2 5B with ComfyUI native offloading | Good candidate | Main route to test\nWan2.1 1.3B / 480P route | Useful fallback | Good diagnostic route\nF2F / FLF | Possible, but risky here | Do not use as face lock\nReActor | Useful in clean cases | Targeted repair only\nVACE 1.3B | Possible later | Useful, but workflow-heavy\nFun Control / pose-control routes | Later | More about structure/motion than face identity\nStand-In / identity-preserving workflows | Interesting later | Probably too early as the next fix\n14B / S2V / all-in-one AV workflows | Heavy | Not the next local 8GB step\n\nThe ComfyUI Wan2.2 docs say the Wan2.2 5B version should fit well on 8GB VRAM with ComfyUI native offloading, so that is the most natural first candidate if you want to stay local.\n\nIf that is still too slow or unstable, a smaller/480P test route is not a failure. The Wan2.1 repo describes the 1.3B model as requiring about 8.19GB VRAM and being aimed at 480P. That makes it useful as a diagnostic route, even if the final quality is lower.\n\nThe key rule is:\n\n> On 8GB, the best workflow is often not the most powerful workflow.\n> It is the smallest workflow that fails in a predictable way.\n\n* * *\n\n## Recommended video-only route\n\nFor now, I would try to make one clean baseline:\n\n\n source image\n → short I2V / TI2V\n → no F2F\n → static camera\n → one small action\n → preservation-heavy positive prompt\n → several seeds\n → choose the best face-stable result\n → repair isolated defects only if needed\n\n\nFor the first stable test, I would keep it boring:\n\nSetting area | Recommendation\n---|---\nClip length | 2–3 seconds\nMotion | one small action only\nCamera | static\nPrompt | explicitly preserve face / lighting / background\nResolution | low enough to iterate\nF2F | off\nSeed | test several\nJudging priority | face first, prompt obedience second\n\nThe first goal is not to make the whole final scene.\n\nThe first goal is only:\n\n> Can I get one short clip where the face, lighting, and background stay mostly stable?\n\nIf yes, then build from there.\n\nDetailed test plan (click for more details)\n\n* * *\n\n## Prompt strategy: do not rely on the end frame anymore\n\nSince F2F is no longer doing the “return to the reference” job, I would not use only an ultra-short prompt like this:\n\n\n char1 looks at char2\n\n\nThat prompt gives the action, but leaves too much open:\n\n * lighting\n * skin tone\n * background\n * camera movement\n * color balance\n * expression intensity\n * face permanence\n * amount of motion\n\n\n\nInstead, I would put the preservation rules into the positive prompt.\n\nExample:\n\n\n same person, same face, same identity, same hairstyle, same clothing,\n same room, same background, same camera angle, static camera,\n same soft lighting, same skin tone, same color balance,\n only subtle natural motion, small eye movement, slight breathing,\n char1 slowly looks toward char2,\n no zoom, no pan, no scene change\n\n\nA short negative prompt is still fine, but I would not depend on the negative prompt as the main control. Especially in low-step / distilled / low-CFG workflows, negative prompts often do less than people expect.\n\nPractical rule:\n\n> Put the important “do not change this” information into the positive prompt, not only into the negative prompt.\n\n* * *\n\n## Where ReActor fits\n\nI would still keep ReActor in the toolbox, but I would narrow its job.\n\nReActor is useful when the face is:\n\n * visible\n * clean\n * not heavily occluded\n * not in complex physical interaction\n * not changing too much across frames\n\n\n\nThe ReActor repo describes it as a face-swap extension and also labels it SFW-friendly. So if interaction shots are triggering sensitivity, black output, or blocked results, I would not fight that as the main path right now.\n\nI would use ReActor more like this:\n\nUse case | ReActor fit\n---|---\nclean portrait repair | good\nsimple visible face | possible\nsimple talking-head style shot | possible\ntwo characters interacting closely | fragile\nhands/arms crossing faces | fragile\nsolving all identity drift | not ideal\n\nSo I would not make ReActor responsible for the whole video. I would use it only where it is naturally strong.\n\n* * *\n\n## Where I2I / frame repair fits\n\nI2I or frame repair is good for isolated defects:\n\nProblem | Better approach\n---|---\none frame has bad jewelry | I2I / inpaint\none hand is wrong | I2I / inpaint / regenerate shot\none face frame is slightly off | targeted repair\nface slowly morphs across the whole clip | shorter clip / better source / better prompt / seed search\nlighting changes mid-clip | remove F2F, shorten clip, preserve lighting in prompt\ninteraction shot breaks | simplify blocking, split into shorter shots\n\nFor interaction scenes, sometimes the best fix is not a stronger node. It is simpler shot design.\n\nExample:\n\n\n Hard version:\n one long shot where two people interact, turn, touch, speak, and move\n\n Easier version:\n shot A: char1 reacts\n shot B: char2 reacts\n shot C: simple wider interaction\n shot D: close-up repair if needed\n\n\nLess glamorous, but much easier to control on 8GB.\n\n* * *\n\nLater branches: VACE, Fun Control, Stand-In, LoRA, 14B (click for more details)\n\n* * *\n\n## Should you move to another workflow just because it has sound nodes?\n\nFor the video side, I would say no — not yet.\n\nA workflow having sound nodes does not automatically solve:\n\n * face consistency\n * F2F lighting bump\n * interaction scenes\n * ReActor sensitivity\n * hands/jewelry/nails\n * color drift\n * video repair\n\n\n\nIt may only move you into a larger workflow with more things to debug.\n\nI would separate the branches:\n\n\n video quality branch\n = face, lighting, hands, motion, shot design\n\n audio branch\n = TTS, audio mux, lip-sync, Foley, sound effects\n\n\nSince you already diagnosed a real video-side issue, I would stabilize that branch first.\n\nThen add audio as a separate branch later.\n\n* * *\n\n## Practical roadmap\n\nStep | Action | Success condition\n---|---|---\n1 | Duplicate the current working workflow | old version remains safe\n2 | Disable F2F / last-frame path | lighting bump does not return\n3 | Make a 2–3 sec I2V/TI2V test | face mostly holds\n4 | Use static camera + one tiny action | less drift\n5 | Add preservation-heavy positive prompt | lighting/background/face hold better\n6 | Try several seeds | at least one acceptable seed\n7 | Repair only isolated defects | avoid rebuilding whole workflow\n8 | Only then test VACE/ReActor/control tools | targeted use, not main path\n9 | Only after video baseline works, return to audio | fewer variables\n\nMain rule:\n\n> Keep the main branch boring.\n> Put risky experiments in copies.\n\n* * *\n\n## Very compact version\n\nIf I compress all of this into one practical recommendation:\n\n> For the video side, I would not switch to a larger workflow yet. On 8GB VRAM, I would first stabilize a small no-F2F I2V/TI2V route: Wan2.2 5B with native offloading if possible, or a smaller/480P diagnostic route if needed. Keep clips very short, use static camera, ask for only one small action, put identity/lighting/background preservation into the positive prompt, and choose the best seed by face permanence first. Use ReActor, I2I repair, VACE, Fun Control, or Stand-In later as targeted repair/control branches — not as the first main solution.\n\nThat seems like the safest next direction from where you are now.",
"title": "Nvidia driver update - reactor node"
}