Skip to main content

The Princess' Butterflies - Using an AI Image to Video Generator to Animate Art That Started as a 23 Year Old Rough Pen Sketch

The Princess' Butterflies - Image to Video with PixVerse AI


B
ack in October of 2023 I used Prome AI's Sketch Rendering feature to color a 23 year old rough pen sketch I did of a princess watching butterflies, sitting next to a waterfall in the forest. You can read more about that in my previous article, The Princess' Butterflies - Using an AI Art Generator to Color and Enhance a 23 Year Old Rough Pen Sketch

The three images I used to create my final image
(bottom right). Notice how closely the AI has followed
my line art sketch (top left) but in the first image
(top right) has misinterpreted the waterfall as some kind
of large tree stump.

Prome's render of the artwork was pretty good but I did end up creating a composite image myself from two of the best renders, to get my final image.

Since then AI Image to Video has come a long way, particularly when it comes to creating animation from artwork and maintaining the art style for the whole generation.

AI still does much better with turning photographic images to video but I found an AI site, PixVerse, that seems more focused on animated styles. Initially I used the site to animate my cartoon TET avatar, which you can read about in my Animation and Video life blog.

Since PixVerse did such a good job at maintaining my art style, by not actually applying any of their art style models to the image (which are all very distinct animation styles like Anime), I thought it might be worth a try running my Princess AI image through to see what happened.

Overall I was quite impressed. I generated four different videos of nine seconds each, getting something reasonably coherent each time.

I did have a few issues like butterflies morphing into a single butterfly, butterflies randomly appearing out of nowhere, and the usual deformed hands (but only if you really look because it tended to happen if the hand moved fast into position).

PixVerse created this 'happy accident' when it randomly generated a magical circle after misinterpreting my prompt.
PixVerse created this 'happy accident' when it randomly
generated a magical circle after misinterpreting my prompt.

One generation I got a happy accident where I attempted to get the butterflies to fly in a more circular formation. Instead the AI interpreted the word circle by adding a magical light circle (kind of like a spell had been cast) appearing around the butterflies.

I decided to take my four generations and edit the best bits together into a single video clip, adding sound effects, music, and even the princess whispering some dialogue. Which was an after thought. It just seemed odd to have all the sound design and the princess, who is clearly speaking, not having any audio.

Although PixVerse does have a lip sync feature that I could have used, I ran out of paid credits, and didn't want to purchase more because I didn't have any immediate need for them after this project - which, in itself, is just a test project. So I just tried to come up with some dialogue using ElevenLabs AI voices that approximated with her lip movement.

You can also generate sound, speech, and even extend the video right in PixVerse but again, I didn't want to purchase the extra credits on a test animation.

The resulting video is below. I tried to edit it so that if you loop it, it's not too jarring, though obviously the dialogue becomes a bit redundant after the second play through. I hope you like it. Feel free to leave a comment to let me know what you think.


Comments

Buy Gifts and Apparel featuring art by TET.

Popular posts from this blog

Movie Review: Captain America: Brave New World (2025) *No Spoilers*

I  decided not see Captain America: Brave New World in a cinema because everything I heard about the film pointed to a disjointed mess, from testing poorly, to whole characters being added in during reshoots. The trailers looked okay but, since they featured Red Hulk, quite a bit, it felt like there wasn't much left as a drawcard for seeing the film in a cinema. Having now seen the film on Disney+ I feel it was a good decision. While the big budget effects no doubt would've looked better on a big screen, the story wasn't particularly complex or intriguing enough to make the film stand out. If anything, it's a straight forward action movie with a hero who is just kind of... there. The story revolves around a plot to kill the newly elected US President, former General Thaddeus Ross (Harrison Ford). Captain America (Anthony Mackie) must find who is the real mastermind in order to clear his friend and the original Super Solider, Isaiah Bradley's (Carl Lumbly), name. I...

I'm Confused About Why People Prefer to Say Discombobulated?

D iscombobulated. Is a word that I think someone rediscovered about three or four years ago (maybe more because the pandemic years have thrown out my sense of time) and now I hear it a lot. It's not a new word by any means, but when I started hearing multiple celebrities using it in everyday sentences, I actively had to look up what it meant. Define it with as many synonyms as you like but essentially it's just another word meaning 'confused'. Seinfeld Quotes: Quotes.net The words are pretty much interchangeable. He was discombobulated by too many choices. He was confused by too many choices.  My confusion is the length of the word. It's unnecessarily long with too many syllables. There are many other words that mean confused, and therefore also mean discombobulated. Most of them are shorter and easier to say. So why not just say 'confused'? Perhaps discombobulated sounds more intelligent, maybe?  Hawaii Five-0 Quotes: Quotes.net I've noticed it gets us...

Resident Dragon: Checking In with My Daily Gag Cartoon/Comic About a Fire Dragon Living in the Suburbs

A t the beginning of the year I introduced you to my latest cartoon/comic series, Resident Dragon (because a dragon's got to live somewhere).  A daily - well, week-day-ly - gag cartoon about Red the Fire Dragon, living in a shared house in the suburbs, with his human friend, TET and his two pets, Grrr Dog and Cool Froyd the cat. Back then I had about 100 cartoons sketched out, with eleven completely digitally inked and coloured.  As of writing this, I haven't yet skipped a day of my schedule, and am seven toons short of an even 200 sketched out, with 31 fully inked and coloured. Actually, it's 33 but I only publish one full colour toon each week, so I have two in the wings. I'm not planning on doing daily toons forever. My goal is to hit 366 so I have enough to fill a daily desk calendar, should I decide to sell one. Currently you can buy individual prints of my finished toons in my Resident Dragon Store . When I have enough finished toons I will be compiling them into...

Australian Federal Election 2025 - World's Most Boring Government Re-elected by Landside - We're Even More Fine!

Anthony Albanese Victory by ChatGPT and TET. W hen I started writing about the 2025 Federal election the polls were suggesting the world's most boring government was crusing to a defeat . As it turns out, boring is good, and Australia wants more of it, handing the current government a landslide win with a majority vote. Anthony Albanese became the first PM since John Howard to win a consecutive term, and the first Labor PM since Bob Hawke to do so. Some of that comes down to the leadership revolving door both major parties had through the mid 2000s. Although Anthony is my preferred PM over Dutton the irony is Dutton sounds more like a leader with a fairly commanding voice and an ability to speak well, without sounding like he's waffling and dodging questions, even if he is. Anthony, on the other hand, does have the ability (and speech writer) to say a lot of inspiring things but it gets lost in the delivery. He doesn't seem to know when to emphasise a point for effect. In h...

TV Series Review: Star Wars: Andor - Season 2 (2025, Disney+) *No Spoilers*

D isney+'s Star Wars: Andor  the first season is widely regarded as some of the best Star Wars since the original trilogy, and I don't disagree in my  Andor Season 1  review. Despite that, it does have its problems, mainly a lot of space between action pieces. That's not to say nothing is happening in those spaces, but I do remember being frustrated how long season one took to get to a promised heist scene, going from conversation to conversation over several episodes. However, when Andor does have action, it usually delivers, with action that serves the story rather than action because 'it's time for some action now'. Unfortunately that gave Andor the reputation for being Star Wars 'for grown ups'. People who understand how tension and intrigue can come just as much from character interaction, who is talking to who, and what they're saying. That lead to low viewership and the show's proposed number of seasons being reduced to just two (I believe...

TV Series Review: Humans (2015-2018, 3 Seasons) *No Spoilers*

Colin Morgan, Katherine Parkinson, Ivanno Jeremiah, Gemma Chan, and Emily Berrington in Humans (2015) W hile it may seem late to be reviewing Humans now, nearly seven years after the show wrapped, the only thing that's really aged about it is the opening titles... and even then, not that much. I think I caught the first season on Netflix back in 2015, and then kind of dropped off waiting for a new season to appear. As of writing this, all three seasons are on Amazon Prime. Humans is set in a parallel world that looks much like ours except humanoid robot helpers, that look just like real humans, called 'Synths', are now common place. Season one begins at the point where the first synths go from being subservient machines to gaining consciousness, and explores not only how humanity reacts to that but how the synths react to humanity's perceptions as well. Initially it follows a group of OG synths, already given consciousness by their creator, and just trying to survive i...

Second Sunday Skateboard Session Episode 6, 7, and 8 - Shuv-its On Lock (Pretty Much)

TET - Heel Flip attempt Episode 8. A s I near the end of filming my ten part series, Second Sundy Skateboard Sessions, I'm feeling pretty good about my skating generally. Filming the series has given me a focus, schedule, and a goal, so that when I do skate I'm not randomly riding around doing not much... and getting bored, or just half arsing attempting to learn my tricks. If you're a solo skater like me - especially if you're learning or relearning - I'd recommend this approach. Even filming your progress. Though you don't have to publicly bore the internet like me if you've got the same 'resting lack of enthusiasm' demeanor I have. Just having the video footage to compare, and to watch in slow mo to see what you're doing wrong or right is useful.  If you're not familiar with me or my ten part series of Second Sunday Skateboard sessions , I'm attempting to master all seven basic skateboarding tricks in Braille Skateboarding's Skateb...