Futurism logo

My green screen test deleted a man's black T-shirt

Creative AI Tests, episode four: FFmpeg's chroma key against two free AI tools, rembg and RVM, on three stock clips and a laptop with no graphics card.

By Gautam AtmakuriPublished about 7 hours ago • 4 min read

The classic green screen key deleted a man's black T-shirt. On a different clip it kept the green and removed the woman standing in front of it. Then two small changes fixed both, and neither of them involved better software.

Creative AI Tests is my Sunday series. Every week I give one tool a real job and report back honestly. This week's question came from a very ordinary place: I wanted to know whether free software can key out a green screen well enough that a green sheet pinned up at home is worth bothering with.

The honest bit first

I haven't shot my own green sheet yet. So for this test I used three free stock clips from Pexels, each one a very different setup.

First up, a bright, even green screen, the kind you'd find in a proper studio. Then a dim and patchy one, a lot like a sheet hung in a spare room. Last, a wide shot where the green doesn't fill the frame, so you can see the room around it.

On the tool side, FFmpeg's chroma key is the classic method. It finds one colour and removes it. The other two are free AI tools that look for a person instead of a colour: rembg, and RVM, which is short for Robust Video Matting.

Everything ran on my laptop's processor. No graphics card. Same six seconds from each clip, same new background behind every result. My script picks the green from the corners of the frame, keys it out, then measures the speed and how much green is left clinging to the edges. I recorded the whole run in the terminal, so what you see in the video is the real output.

Clip one: the bright screen

FFmpeg won this one easily. Clean edges, flicks of hair kept and the fastest of the three by a long way.

Out of curiosity I loosened the setting to catch more green. She went see-through. Looser isn't better, and I'd like that on a fridge magnet.

Both AI tools kept her solid but left a green halo. rembg left a green tint on about 29 percent of the edge and crawled along at around two frames a second. RVM was cleaner, about 20 percent, at eleven frames a second.

Clip two: the dim, patchy screen

Here FFmpeg fell apart. Dim green sits close to black, so it couldn't tell the screen from his black T-shirt and dark hair. Both went with the background. When I loosened the setting, he vanished altogether.

Neither AI tool lost him. RVM was at its best on this clip, with almost no green on the edges. Fair play to it.

Clip three: the wide shot

Clip three was almost funny. The corners of the frame were the room, not the green. So the keyer picked the white wall as the colour to remove, took the woman out and kept the screen. Technically it did exactly what I told it to.

What actually went wrong

Software wasn't the problem. The light on the sheet, and the colour I picked, were.

So I ran a second pass with the same free tool. I picked the green by hand from a bright patch of the sheet instead of trusting the corners. On the wide shot I also cropped away everything that wasn't sheet, and it came out clean.

That dim clip needed one more step. I halved the setting so it only took that exact green, and the shirt came back.

Those two fixes beat the AI tools on the edges and still ran at about real time. That's the bit worth remembering.

Mr. Mummu, who turns up in these posts now and then, tried his own version with a green tablecloth. He aimed every lamp in the house at his face and left the cloth in shadow. On the video call the cloth came out as a murky grey-green blob and his virtual beach never appeared, which he took as a sign the cloth was faulty. The notebook marked "Urgent" now has a new line, written after the third lamp: cloth gets the light, not me. He's right, and it took him less time than it took me.

Where the AI tools earn their place

AI tools do have one real advantage. They ignored the light stands in the shots without being told, because they look for a person rather than a colour. But they don't clean up green spill, so plan on fixing the edges either way.

If you've got a sheet at home

Light it as evenly as you can. Pick the green by hand. Crop off anything that isn't sheet. And keep a free AI tool as your backup for the shots where the classic key wants to eat your clothes.

My honest limit here: these were three stock clips, six seconds each, judged on one laptop. My own spare room with a real sheet might behave differently, and I'll find out when I shoot it.

You can watch the full test, just under four minutes, on my YouTube channel, Gautam Atmakuri, in the Creative AI Tests playlist. I'll put the link in the comments. Next week I turn a single photo into 3D with a free tool.

What would you put behind yourself?

Free tools are good enough. Even light and a careful pick matter more than the software.

tech

About the Creator

Gautam Atmakuri

I once spent seven days blindfolded, silent and without food to see what my senses were hiding. I write about that, my baby boy, barefoot running, Tirupati to Auckland life, and the business, marketing and tech I build at AumnI digital.

Enjoyed the story? Support the Creator.

Subscribe for free to receive all their stories in your feed. You could also become a paid subscriber, letting them know you appreciate their work.

Subscribe For Free

Reader insights

Comments

There are no comments for this story

Be the first to respond and start the conversation.

Sign in to comment
    Written by Gautam Atmakuri