Did We Just Change Animation Forever?
Why Hacker News recommends it
HN cites it as an example of temporally stable AI video stylization built from ordinary production gear.
What it is
Corridor Crew explain how they made an anime short by filming themselves and running the footage through custom-trained Stable Diffusion models. The video walks through the technique and its open-source foundations.
Recommended by 1 HN commenters across 1 different months, 2023 to 2024.
What Hacker News said
Recommends samspenc · 2023-03 · on “Introducing ChatGPT and Whisper APIs”
I thought Midjourney was better as well, until I saw some recent videos from Corridor Crew on Youtube. For those who don't know, this is a VFX studio in LA that tries to keep at the cutting-edge of video production techniques and posts content to their Youtube channel, and they have a massive number of followers and several viral videos. They recently created a full 7-minute anime using Stable Diffusion with their own models and their existing video production gear, I'll post the links and let the results speak for themselves The actual 7-minute anime piece produced using SD: [LINK] Behind the scenes: "Did we change anime forever?" [this video] "VFX reveal before and after" [LINK]
Cites sschueller · 2023-02 · on “Diffusion with Offset Noise: Finetuning SD to generate very dark or light images”
The whole thing with SD is extremely interesting and difficult to keep up with as there are so many new things coming in almost daily. Just last week I saw ControlNet[1] which ads a lot more control. Today I saw what corridor crew[2] did to stabilize the randomness when you want to make videos. Very exciting. [1] [LINK] [2] [this video]
Cites Kelamir · 2023-03 · on “Anime rock, paper, scissors [video]”
The characters here are processed with Stable Diffusion. This is an impressive progress in the field of video generation with help of AI, considering how consistent the generated characters look like across frames, in my opinion. Also here is another video [this video] "Did We Just Change Animation Forever?" where they demonstrated how it came to be.
Cites yummypaint · 2023-03 · on “Wonder Studio: this AI-powered tool might be a preview of the future of VFX”
This reminds me alot of this techniquefor turning live action into animation: [this video] It unsurprisingly received alot of pushback from people in the industry but I think it's really impressive.
Cites dbspin · 2023-03 · on “If AI scaling is to be shut down, let it be for a coherent reason”
The issues you mention with Stable Diffusion are teething issues. Here's an example of a current technique to get temporally stable animations with Stable Diffusion - [LINK] Corridor digital show off a similar technique here - [this video] GPT4 with its new plugin architecture is rapidly becoming more capable. I think you're absolutely correct in the tendency of all LLMs to hallucinate is a major issue that we don't know how to correct even in principle. But there are techniques to moderate its impact on responses - triangulating using multiple models, citing sources etc. You could build an assistant like say this, today - [LINK] to make your appointments and answer the phone today, using technol
Cites someperson · 2024-02 · on “Sora: Creating video from text”
> There was a video of some guys doing this (sorry can’t find it) to make an anime type animation. With consistent characters. They used videos of themselves running through their own models to make the characters. That was Corridor Crew: [this video]