The Princess' Butterflies - Using an AI Image to Video Generator to Animate Art That Started as a 23 Year Old Rough Pen Sketch

The Princess' Butterflies - Image to Video with PixVerse AI

Back in October of 2023 I used Prome AI's Sketch Rendering feature to color a 23 year old rough pen sketch I did of a princess watching butterflies, sitting next to a waterfall in the forest. You can read more about that in my previous article, The Princess' Butterflies - Using an AI Art Generator to Color and Enhance a 23 Year Old Rough Pen Sketch

The three images I used to create my final image
(bottom right). Notice how closely the AI has followed
my line art sketch (top left) but in the first image
(top right) has misinterpreted the waterfall as some kind
of large tree stump.

Prome's render of the artwork was pretty good but I did end up creating a composite image myself from two of the best renders, to get my final image.

Since then AI Image to Video has come a long way, particularly when it comes to creating animation from artwork and maintaining the art style for the whole generation.

AI still does much better with turning photographic images to video but I found an AI site, PixVerse, that seems more focused on animated styles. Initially I used the site to animate my cartoon TET avatar, which you can read about in my Animation and Video life blog.

Since PixVerse did such a good job at maintaining my art style, by not actually applying any of their art style models to the image (which are all very distinct animation styles like Anime), I thought it might be worth a try running my Princess AI image through to see what happened.

Overall I was quite impressed. I generated four different videos of nine seconds each, getting something reasonably coherent each time.

I did have a few issues like butterflies morphing into a single butterfly, butterflies randomly appearing out of nowhere, and the usual deformed hands (but only if you really look because it tended to happen if the hand moved fast into position).

PixVerse created this 'happy accident' when it randomly
generated a magical circle after misinterpreting my prompt.

One generation I got a happy accident where I attempted to get the butterflies to fly in a more circular formation. Instead the AI interpreted the word circle by adding a magical light circle (kind of like a spell had been cast) appearing around the butterflies.

I decided to take my four generations and edit the best bits together into a single video clip, adding sound effects, music, and even the princess whispering some dialogue. Which was an after thought. It just seemed odd to have all the sound design and the princess, who is clearly speaking, not having any audio.

Although PixVerse does have a lip sync feature that I could have used, I ran out of paid credits, and didn't want to purchase more because I didn't have any immediate need for them after this project - which, in itself, is just a test project. So I just tried to come up with some dialogue using ElevenLabs AI voices that approximated with her lip movement.

You can also generate sound, speech, and even extend the video right in PixVerse but again, I didn't want to purchase the extra credits on a test animation.

The resulting video is below. I tried to edit it so that if you loop it, it's not too jarring, though obviously the dialogue becomes a bit redundant after the second play through. I hope you like it. Feel free to leave a comment to let me know what you think.

Comments

Checking in on Tesla's Optimus Robot - Managing Expectations

Last year Elon Musk announced at the first Tesla AI day the Tesla Bot, which has since been renamed the Tesla Optimus, that is basically a general purpose humanoid robot assistant with human like appearance and proportions. Elon expected they would have a working prototype by the end of 2022. While very little has been released about the project since, in June Elon took to Twitter to announce that they would delay this year's Tesla AI day until September 30 in anticipation of having a working prototype of the robot by that time. Elon Musk announces the Tesla Bot at the 2021 Tesla AI day. When I initially wrote about the Tesla Bot I noted that both Boston Dynamics and Disney Imagineering are developing robot technologies that demonstrate a streamlined, humanoid robot like Optimus is certainly possible. However with precious few details, and the occasional appearance of static, concept manikins of Tesla Optimus bots at places like the Cyber Rodeo Gigafactory Austin, Texas (see vi...

Is AI Art 'Art'? The Say NO to AI Art Movement, and Why Human Artists Will Adapt

AI Art No T-Shirt by TET Also available on other items . Right now there is a big debate over not just whether AI art is 'art' but whether AI's are actually ripping off the work of actual human artists, without their consent, to create their images - particularly images 'in the style of' specific artists. From my own observations this debate started to get more traction when artist's signatures began appearing in the output of AI Art image generators. Is It Art? Cool Froyd the Cat Sketch by TET. My style is very much influenced by classic Disney and WB character styles. To get some clarity on how real human artists work (of which I am one)... we, that is all of us... take influences from the art that has come before. i.e. whatever artists we like, have studied, seen etc. we are influenced by. It shows up in our work, intentionally or not. If you really study my own cartoony art style you'll see I'm heavily influenced by early Disney and Warner Bros cart...

James Gunn's Social Media Monkeys Joke Was a Highlight of His Superman Movie For Me

B efore James Gunn's Superman Movie was released there was a whole rumor going around that the movie would feature monkeys on computers trolling Superman's social media, sparking much outrage. #supersh*t. I didn't know this was even a thing until just prior to writing this article. I did a search to see if anyone had posted a clip of the monkeys scene from the movie and got pages of discourse featuring videos and articles prior to the film. Most of it from Gunn detractors (let's say) seeing it as some kind of childish swipe at them... well not them specifically but, you know, those other people who have every right to hate on anything sight unseen. Anyway, I'm not going to give even one such example a link or air because it's kind of sad watching someone devote so much commentary to a throw away gag that is absolutely a nod to James Gunn's Superman trolls. The whole reason this post exists, is to say I loved the joke, because fourteen years ago, and I...

Dusting Off the Board Slider - Second Sunday Skate Sessions S02/Ep01 (Skateboard Basics)

My home made 'curb' board slider. S eason 02, Episode 01 of my ten part, Second Sunday Skate Sessions Series is here. I'm still working to master the tricks of Braille Skateboarding's Skateboarding Made Simple Volume One, however, this season will be more focused on my 'curb' Board Slider, that I built, and seeing what tricks I can learn on that. If you're actually interested in following my full progress of relearning to skateboard, the first season can be viewed in these posts: Introducing the Second Sunday Skateboard Sessions - Doing Less to Skateboard More Second Sunday Skateboard Session Ep 2 - Some Improvements Second Sunday Skateboard Session Episode 3, 4, and 5 - Definitely Seeing Progress Second Sunday Skateboard Session Episode 6, 7, and 8 - Shuv-its On Lock (Pretty Much) Second Sunday Skateboard Session Episode 9, and 10 - Shuv-it Revelation and Did I Improve? In this episode I do a quick run through of Skateboarding made simple tricks just to sh...

Boom Crash Opera Born Classic But Not Again

Boom Crash Opera are an Australian Band that reached the peak of their popularity in the mid to late nineteen eighties. They are a band that I knew about at that time but was never really excited by until they released their ill fated double album Born and Born Again in 1995 (Album cover pictured). At the time of its release I was very much into emerging Australian musical acts and was also looking out for new sounds that were different and had kind of a futuristic/electronic sound. Artists that I was buying at the time included; Swoop , Nine Inch Nails and Pop Will Eat Its Self . As well as a really interesting release by David Bowie, the concept album, Outside . Born was a fairly radical departure for Boom Crash Opera (BCO). The first single, Gimme , was often compared to the sounds of Gary Glitter, particularly his single, Rock n Roll part 2 , because of the pounding drum loops. Watch the video below. My favorite single from the album is dissemble which probably went now...

Are Ion Thrusters the Future of Flying Cars? Spoiler - Probably Not But... Hover Boards... Maybe?

Undefined Technologies Ion Propulsion Drone prototype 3D concept image. You may have heard of Ion engines or, more likely, Ion thrusters. NASA uses them on their spacecraft to help maintain a craft's position or to propel them through space. Upon hearing that you might think they're big, powerful engines, but actually they are not. They work well in the vacuum of space but, once any kind of atmosphere and gravity is involved they'd be hard pressed to launch you off the ground if you strapped four of them to your lawn chair and yelled "up, up, and away!" I am no expert on Ion thrusters - they're basically magic that science has an explanation for. If you want to know the details, The Space Techie website has a layman's explanation . Build Your Own Ion Thruster Earth based Ion Thrusters work a bit different to their space based cousins by Ionizing the same air that we breathe to create thrust (an effect known as Ionic-wind ). While they sound highly soph...

TV Series Review: Bat-Fam (2025 Amazon Prime) Spoiler Free

I am surprised I did not review Merry Little Batman (2023), the animated movie from Amazon Prime that clearly proved to be so popular they turned it into a ten episode series titled, Bat-Fam (2025). While neither the film or the series are intended for adults, they're still very watchable for older fans. Making them a great family experience for parents looking to introduce their younger children to the more fun aspects of Batman lore. Both kind of fill a similar space that Adam West's 66 Batman did, except I don't think, even young children, would take Bat-Fam as seriously as young kids took the 66's Batman series back in the day. It's been a couple of years since I watched the original Merry Little Batman movie (but it's a fun Christmas movie, and I highly recommend it), so I'm not going to review that here. You don't need to have seen it but it does give you some context for Damien (Yonas Kibreab) being 'Little Batman' rather than Robin. Be...

TET.Life (The Extraordinary Tourist Life)

Search This Blog