The Princess' Butterflies - Using an AI Image to Video Generator to Animate Art That Started as a 23 Year Old Rough Pen Sketch

The Princess' Butterflies - Image to Video with PixVerse AI

Back in October of 2023 I used Prome AI's Sketch Rendering feature to color a 23 year old rough pen sketch I did of a princess watching butterflies, sitting next to a waterfall in the forest. You can read more about that in my previous article, The Princess' Butterflies - Using an AI Art Generator to Color and Enhance a 23 Year Old Rough Pen Sketch

The three images I used to create my final image
(bottom right). Notice how closely the AI has followed
my line art sketch (top left) but in the first image
(top right) has misinterpreted the waterfall as some kind
of large tree stump.

Prome's render of the artwork was pretty good but I did end up creating a composite image myself from two of the best renders, to get my final image.

Since then AI Image to Video has come a long way, particularly when it comes to creating animation from artwork and maintaining the art style for the whole generation.

AI still does much better with turning photographic images to video but I found an AI site, PixVerse, that seems more focused on animated styles. Initially I used the site to animate my cartoon TET avatar, which you can read about in my Animation and Video life blog.

Since PixVerse did such a good job at maintaining my art style, by not actually applying any of their art style models to the image (which are all very distinct animation styles like Anime), I thought it might be worth a try running my Princess AI image through to see what happened.

Overall I was quite impressed. I generated four different videos of nine seconds each, getting something reasonably coherent each time.

I did have a few issues like butterflies morphing into a single butterfly, butterflies randomly appearing out of nowhere, and the usual deformed hands (but only if you really look because it tended to happen if the hand moved fast into position).

PixVerse created this 'happy accident' when it randomly
generated a magical circle after misinterpreting my prompt.

One generation I got a happy accident where I attempted to get the butterflies to fly in a more circular formation. Instead the AI interpreted the word circle by adding a magical light circle (kind of like a spell had been cast) appearing around the butterflies.

I decided to take my four generations and edit the best bits together into a single video clip, adding sound effects, music, and even the princess whispering some dialogue. Which was an after thought. It just seemed odd to have all the sound design and the princess, who is clearly speaking, not having any audio.

Although PixVerse does have a lip sync feature that I could have used, I ran out of paid credits, and didn't want to purchase more because I didn't have any immediate need for them after this project - which, in itself, is just a test project. So I just tried to come up with some dialogue using ElevenLabs AI voices that approximated with her lip movement.

You can also generate sound, speech, and even extend the video right in PixVerse but again, I didn't want to purchase the extra credits on a test animation.

The resulting video is below. I tried to edit it so that if you loop it, it's not too jarring, though obviously the dialogue becomes a bit redundant after the second play through. I hope you like it. Feel free to leave a comment to let me know what you think.

Comments

Movie Review: A Complete Unknown (2024) No Spoilers

Y ou would think the Bob Dylan story would be 'wind-swept and interesting,' to quote Billy Connelly, however, despite A Complete Unknown being quite an engaging film, it feels like it missed the years that really shaped him as a song writer/performer. The film starts in 1961, with a then unknown, 19-year-old Bob Dylan (Timothée Chalamet) arriving in New York City with his guitar. From there he forges relationships with musical icons on his meteoric rise, culminating in a groundbreaking performance that reverberates around the world. The problem being, according to this film, Dylan arrived in New York, for the most part, fully formed as a folk singer/song writer. In virtually no time he makes a very important connection that puts him on the trajectory of doing the work and becoming a name, before making his world changing performance. While there is some drama behind the scenes with his various relationships, none of it is particularly unique to any number of up and com...

TV Series Review: Humans (2015-2018, 3 Seasons) No Spoilers

Colin Morgan, Katherine Parkinson, Ivanno Jeremiah, Gemma Chan, and Emily Berrington in Humans (2015) W hile it may seem late to be reviewing Humans now, nearly seven years after the show wrapped, the only thing that's really aged about it is the opening titles... and even then, not that much. I think I caught the first season on Netflix back in 2015, and then kind of dropped off waiting for a new season to appear. As of writing this, all three seasons are on Amazon Prime. Humans is set in a parallel world that looks much like ours except humanoid robot helpers, that look just like real humans, called 'Synths', are now common place. Season one begins at the point where the first synths go from being subservient machines to gaining consciousness, and explores not only how humanity reacts to that but how the synths react to humanity's perceptions as well. Initially it follows a group of OG synths, already given consciousness by their creator, and just trying to survive i...

I'm Confused About Why People Prefer to Say Discombobulated?

D iscombobulated. Is a word that I think someone rediscovered about three or four years ago (maybe more because the pandemic years have thrown out my sense of time) and now I hear it a lot. It's not a new word by any means, but when I started hearing multiple celebrities using it in everyday sentences, I actively had to look up what it meant. Define it with as many synonyms as you like but essentially it's just another word meaning 'confused'. Seinfeld Quotes: Quotes.net The words are pretty much interchangeable. He was discombobulated by too many choices. He was confused by too many choices. My confusion is the length of the word. It's unnecessarily long with too many syllables. There are many other words that mean confused, and therefore also mean discombobulated. Most of them are shorter and easier to say. So why not just say 'confused'? Perhaps discombobulated sounds more intelligent, maybe? Hawaii Five-0 Quotes: Quotes.net I've noticed it gets us...

Australian Federal Election 2025 - World's Most Boring Government Re-elected by Landside - We're Even More Fine!

Anthony Albanese Victory by ChatGPT and TET. W hen I started writing about the 2025 Federal election the polls were suggesting the world's most boring government was crusing to a defeat . As it turns out, boring is good, and Australia wants more of it, handing the current government a landslide win with a majority vote. Anthony Albanese became the first PM since John Howard to win a consecutive term, and the first Labor PM since Bob Hawke to do so. Some of that comes down to the leadership revolving door both major parties had through the mid 2000s. Although Anthony is my preferred PM over Dutton the irony is Dutton sounds more like a leader with a fairly commanding voice and an ability to speak well, without sounding like he's waffling and dodging questions, even if he is. Anthony, on the other hand, does have the ability (and speech writer) to say a lot of inspiring things but it gets lost in the delivery. He doesn't seem to know when to emphasise a point for effect. In h...

Movie Review: Captain America: Brave New World (2025) No Spoilers

I decided not see Captain America: Brave New World in a cinema because everything I heard about the film pointed to a disjointed mess, from testing poorly, to whole characters being added in during reshoots. The trailers looked okay but, since they featured Red Hulk, quite a bit, it felt like there wasn't much left as a drawcard for seeing the film in a cinema. Having now seen the film on Disney+ I feel it was a good decision. While the big budget effects no doubt would've looked better on a big screen, the story wasn't particularly complex or intriguing enough to make the film stand out. If anything, it's a straight forward action movie with a hero who is just kind of... there. The story revolves around a plot to kill the newly elected US President, former General Thaddeus Ross (Harrison Ford). Captain America (Anthony Mackie) must find who is the real mastermind in order to clear his friend and the original Super Solider, Isaiah Bradley's (Carl Lumbly), name. I...

Now More Than Ever It's Important Not To Take Things At Face Value - AI Scams Are Very Real

This image is a totally legit photo of me on the moon trying to sell you a bridge.* Photo by Artflow, Copilot, and TET S cam's are nothing new but, as technology makes everything easier, it's also making it easier for you to be scammed by something that seems very legit. Things that used to indicate something was on the level can very easily be faked by generative AI in a practice known as 'deep faking'. Where a person's likeness (image and voice) is used to generate video of them doing or saying something they didn't. As one of the best examples of what's currently possible, YouTube Channel floydbishop , has made a PSA video titled, Watch This Fake AI Video Scam — Then Show It to Your Parents , that is 100% AI generated... i.e. it's ALL fake. Not a single human appears on camera, and not a single human voice is heard. Watch the video below. If you watch closely, some scenes have small 'tells' that are common AI errors, such as items magically ...

China is Leading on Thorium Nuclear Energy, A Source That is More Efficient, More Available, and Produces Less Nuclear Waste Than Uranium

Early thorium-based (MSR) nuclear reactor at Oak Ridge National Laboratory in the 1960s By ORNL " Image courtesy of Oak Ridge National Laboratory " I f there was an energy source more efficient, safer, more available, and produces less nuclear waste with a significantly less decay time before it becomes safe again, you'd think countries would be climbing over themselves to jump on board. Thorium is that source, and it was extensively researched by the USA in the 1960's, ultimately losing out to Uranium because Uranium was cheaper and served a duel role in the nuclear arms race of the time. That leads us to today, where Uranium Nuclear reactors are an entire industry, with strong foot holds in many countries around the globe, and Thorium is still stuck in development hell. Even if the Nuclear industry did decide to pivot, it would be decades before Thorium would actually deliver on the benefits of using it. It's not as simple as swapping fuel in existing reactors. ...

TET.Life (The Extraordinary Tourist Life)

Search This Blog