Skip to main content

The Princess' Butterflies - Using an AI Image to Video Generator to Animate Art That Started as a 23 Year Old Rough Pen Sketch

The Princess' Butterflies - Image to Video with PixVerse AI


B
ack in October of 2023 I used Prome AI's Sketch Rendering feature to color a 23 year old rough pen sketch I did of a princess watching butterflies, sitting next to a waterfall in the forest. You can read more about that in my previous article, The Princess' Butterflies - Using an AI Art Generator to Color and Enhance a 23 Year Old Rough Pen Sketch

The three images I used to create my final image
(bottom right). Notice how closely the AI has followed
my line art sketch (top left) but in the first image
(top right) has misinterpreted the waterfall as some kind
of large tree stump.

Prome's render of the artwork was pretty good but I did end up creating a composite image myself from two of the best renders, to get my final image.

Since then AI Image to Video has come a long way, particularly when it comes to creating animation from artwork and maintaining the art style for the whole generation.

AI still does much better with turning photographic images to video but I found an AI site, PixVerse, that seems more focused on animated styles. Initially I used the site to animate my cartoon TET avatar, which you can read about in my Animation and Video life blog.

Since PixVerse did such a good job at maintaining my art style, by not actually applying any of their art style models to the image (which are all very distinct animation styles like Anime), I thought it might be worth a try running my Princess AI image through to see what happened.

Overall I was quite impressed. I generated four different videos of nine seconds each, getting something reasonably coherent each time.

I did have a few issues like butterflies morphing into a single butterfly, butterflies randomly appearing out of nowhere, and the usual deformed hands (but only if you really look because it tended to happen if the hand moved fast into position).

PixVerse created this 'happy accident' when it randomly generated a magical circle after misinterpreting my prompt.
PixVerse created this 'happy accident' when it randomly
generated a magical circle after misinterpreting my prompt.

One generation I got a happy accident where I attempted to get the butterflies to fly in a more circular formation. Instead the AI interpreted the word circle by adding a magical light circle (kind of like a spell had been cast) appearing around the butterflies.

I decided to take my four generations and edit the best bits together into a single video clip, adding sound effects, music, and even the princess whispering some dialogue. Which was an after thought. It just seemed odd to have all the sound design and the princess, who is clearly speaking, not having any audio.

Although PixVerse does have a lip sync feature that I could have used, I ran out of paid credits, and didn't want to purchase more because I didn't have any immediate need for them after this project - which, in itself, is just a test project. So I just tried to come up with some dialogue using ElevenLabs AI voices that approximated with her lip movement.

You can also generate sound, speech, and even extend the video right in PixVerse but again, I didn't want to purchase the extra credits on a test animation.

The resulting video is below. I tried to edit it so that if you loop it, it's not too jarring, though obviously the dialogue becomes a bit redundant after the second play through. I hope you like it. Feel free to leave a comment to let me know what you think.


Comments

Buy Gifts and Apparel featuring art by TET.

Popular posts from this blog

How to Transfer Any Line Art to Your Griptape - Easy Skateboard Griptape Art Tutorial

Dog Star Griptape Art by TET Griptape art is once again gaining popularity amongst modern skateboarders. For those of us who have tried to create our own griptape art, using paint pens, you'll know reproducing your design onto the grip, without making any mistakes is incredibly challenging. Mostly because you just have to go for it and draw the design freehand, with paint pens, directly onto the griptape. You can make the odd mistake here or there but if you get the proportions of the design completely wrong, it can be very difficult to fix. Often you just have to live with the mistake. To address the problem I've come up with an easy way anyone can transfer a line art design to their griptape, removing almost all the anxiety of getting the proportions wrong. In fact, you could do this with any line art design, even if you have no drawing skill at all. Watch the video below to see my technique in action and/or skip past the video where I highlight the basic steps to get your de...

James Gunn's Social Media Monkeys Joke Was a Highlight of His Superman Movie For Me

B efore James Gunn's Superman Movie was released there was a whole rumor going around that the movie would feature monkeys on computers trolling Superman's social media, sparking much outrage. #supersh*t. I didn't know this was even a thing until just prior to writing this article. I did a search to see if anyone had posted a clip of the monkeys scene from the movie and got pages of discourse featuring videos and articles prior to the film. Most of it from Gunn detractors (let's say) seeing it as some kind of childish swipe at them... well not them specifically but, you know, those other people who have every right to hate on anything sight unseen. Anyway, I'm not going to give even one such example a link or air because it's kind of sad watching someone devote so much commentary to a throw away gag that is absolutely a nod to James Gunn's Superman trolls.  The whole reason this post exists, is to say I loved the joke, because fourteen years ago, and I...

Is AI Art 'Art'? The Say NO to AI Art Movement, and Why Human Artists Will Adapt

AI Art No T-Shirt by TET Also available on other items . Right now there is a big debate over not just whether AI art is 'art' but whether AI's are actually ripping off the work of actual human artists, without their consent, to create their images - particularly images 'in the style of' specific artists. From my own observations this debate started to get more traction when artist's signatures began appearing in the output of AI Art  image generators. Is It Art? Cool Froyd the Cat Sketch by TET. My style is very much influenced by classic Disney and WB character styles. To get some clarity on how real human artists work (of which I am one)... we, that is all of us... take influences from the art that has come before. i.e. whatever artists we like, have studied, seen etc. we are influenced by. It shows up in our work, intentionally or not. If you really study my own cartoony art style you'll see I'm heavily influenced by early Disney and Warner Bros cart...

I'm Joining the Illuminati Brotherhood By Personal Invitation of Hiltom Rothschild... Wait, What?

How special am I to have finally come of age (53 years young) and am now eligible to participate in building the world alongside other members of the Illuminati Brotherhood... Yes I've received the call by way of an email, which I'm sure is real because I had to translate it from the Dutch language and it was personally written by Hiltom Rothschild, one of the non-existent members of the Rothschild family (or perhaps deep undercover because Google has never heard of them?). A Transcript of the email below: To: etourist From: Illuminati Brotherhood  Subject: Illuminati Broederschap (Illuminati Brotherhood) I am Hiltom Rothschild, a member of the Rothschild family, one of the 13 families of the Illuminati brotherhood. I'm here to let you know that you've come of age and are eligible to participate in building the 🌎 world. It is a calling and a privilege to honor him with pride and gratitude as not everyone will ever be chosen by the LIGHT, many are called but few are ch...

The Worst Book I Have Ever Read - Gulp: Travels Around the Gut by Mary Roach

TET and Mary Roach's Book, Gulp . I 'm the kind of person who only reads one physical book at a time. For context I consider a 'book' to be anything over 100 pages of mostly text. Basically your typical work of fiction novel or factual biography. It's not that I can't read more than one book at a time, I just choose not to because I don't set a lot of time aside for reading. Maybe 30 minutes a day when I'm on a good run with a really engaging text. Little did I know that Mary Roach's Gulp: Travels Around the Gut *, a book of 317 pages (minus the Acknowledgments and Bibliography) would become a bottle neck for my reading for the next three and a half years. As such, I'm calling it the worst book I have ever read. Despite how long it took me to read, it is not a bad book in the slightest, and is in fact, quite light, somewhat entertaining, reading for a book that explores the science, and the resilience of the human digestive system.  I'm no st...

Skateboarders Who Ever Dreamed of Dropping In on a City Building - Sandro Dias Just Lived Your Dream

Dias's drop-in from one of the lower platforms for practice. Image: © Marcelo Maragni/Red Bull I f you're a skateboarder living in a city you've probably looked at a building that has skate ramp vibes and imagined dropping in on it... well Professional Skateboarder, Sandro Dias didn't just imagine. The Perth Telstra Building as depicted in this fantasy poster print, Forbidden Skate Ramp by  Harry Young. If you lived in Perth, Western Australia, any skateboarder who saw the top of the Telstra Building likely had the same thought about the ramp like quarter pipe at the top. Also, back in the day there was a classic skateboarding poster going the rounds that depicted Sydney as a literal skatepark with ramps built up, down, and over numerous buildings. Sandro Dias, who broke the record for the world's tallest drop-in on the 26th September 2025 by dropping in on a mega ramp built on the side of the curved façade of the 22-storey Centro Administrativo Fernando Ferrari (C...

Roary the Racing Car is Evil

Well okay maybe the lovable little red racing car, that has his own TV show, Roary the Racing Car , isn't evil but I do suspect he's into brain washing. Subliminally teaching everyone his life lessons. How else do you explain a fully grown adult, namely me, waking up in the morning from a dream about Roary? Before your mind begins to wander, it's nothing even remotely perverse (or maybe it is, depending on how you look at things), my dream was simply playing out like a typical episode of Roary the Racing Car. Perhaps we should back up a bit. In your best 'Big Chris' voice say "Come on Roary!" This all starts because I do my daily work out routine watching Judge Judy . Exercise is as boring as hell (oh dear, coarse language) so I watch TV whilst I go through my routine. At 3pm the most intelligent show on the box is, you guessed it, Judge Judy. Her show is only 30 minutes long and my routine is an hour so at 3:30pm I need something else to watch. Channel fl...