The Princess' Butterflies - Using an AI Image to Video Generator to Animate Art That Started as a 23 Year Old Rough Pen Sketch

The Princess' Butterflies - Image to Video with PixVerse AI

Back in October of 2023 I used Prome AI's Sketch Rendering feature to color a 23 year old rough pen sketch I did of a princess watching butterflies, sitting next to a waterfall in the forest. You can read more about that in my previous article, The Princess' Butterflies - Using an AI Art Generator to Color and Enhance a 23 Year Old Rough Pen Sketch

The three images I used to create my final image
(bottom right). Notice how closely the AI has followed
my line art sketch (top left) but in the first image
(top right) has misinterpreted the waterfall as some kind
of large tree stump.

Prome's render of the artwork was pretty good but I did end up creating a composite image myself from two of the best renders, to get my final image.

Since then AI Image to Video has come a long way, particularly when it comes to creating animation from artwork and maintaining the art style for the whole generation.

AI still does much better with turning photographic images to video but I found an AI site, PixVerse, that seems more focused on animated styles. Initially I used the site to animate my cartoon TET avatar, which you can read about in my Animation and Video life blog.

Since PixVerse did such a good job at maintaining my art style, by not actually applying any of their art style models to the image (which are all very distinct animation styles like Anime), I thought it might be worth a try running my Princess AI image through to see what happened.

Overall I was quite impressed. I generated four different videos of nine seconds each, getting something reasonably coherent each time.

I did have a few issues like butterflies morphing into a single butterfly, butterflies randomly appearing out of nowhere, and the usual deformed hands (but only if you really look because it tended to happen if the hand moved fast into position).

PixVerse created this 'happy accident' when it randomly
generated a magical circle after misinterpreting my prompt.

One generation I got a happy accident where I attempted to get the butterflies to fly in a more circular formation. Instead the AI interpreted the word circle by adding a magical light circle (kind of like a spell had been cast) appearing around the butterflies.

I decided to take my four generations and edit the best bits together into a single video clip, adding sound effects, music, and even the princess whispering some dialogue. Which was an after thought. It just seemed odd to have all the sound design and the princess, who is clearly speaking, not having any audio.

Although PixVerse does have a lip sync feature that I could have used, I ran out of paid credits, and didn't want to purchase more because I didn't have any immediate need for them after this project - which, in itself, is just a test project. So I just tried to come up with some dialogue using ElevenLabs AI voices that approximated with her lip movement.

You can also generate sound, speech, and even extend the video right in PixVerse but again, I didn't want to purchase the extra credits on a test animation.

The resulting video is below. I tried to edit it so that if you loop it, it's not too jarring, though obviously the dialogue becomes a bit redundant after the second play through. I hope you like it. Feel free to leave a comment to let me know what you think.

Comments

What a Future with Flying Cars Might Look Like

Jetsons Style Flying Car - Image by TET & Leonardo.ai Regular readers of this blog will know that flying cars have been a recurring subject over the years. I even collected all my posts into a book you can buy on Amazon Kindle called Where's My Flying Car? The development of a true flying car is a fanciful one, largely because we've yet to come up with anything that actually looks like a car that flies. Most serious projects that even make it to a prototype are either small planes that compact into something you might drive from your home to an airport (if they don't have any vertical landing and take off (VTOL) capability) but you wouldn't drive to you local supermarket for the weekly groceries run, or they're some kind of drone/helicopter configuration with so many propellers you'll worry about shredding pedestrians who get too close. The dream is something that looks exactly like a car but can drive on a road, or hover (kind of like Luke Skywalker's ...

Review: ArtHelper - The All-In-One AI Writing + Marketing Assistant for Artists - 'ChatGPT for Artists'

ArtHelper prides itself on being all 'human-made' art. T he idea of an AI, trained specifically on art business marketing, that can not only offer advice on marketing your work, but also assist with creating all the content too, is certainly appealing. Especially to those of us who would rather spend more time creating our art than trying to sell it. ArtHelper does just that whilst attempting to be your 'home' on the internet. A destination for your profile and portfolio, a marketplace for your art, and a directory of artists as well, with one distinction - all the art must be human made. Which, for you AI artists, doesn't count the prompt for AI generated art - because the idea, according to ArtHelper's creators, isn't the art. Which is a fair point, in terms of promoting art 'made by a human', but can get kind of murky when you understand that not all AI art is generated from a single prompt... and 'found object art' isn't actually ...

New Cat Art Collaboration: TET's Cats Paintings and OpenArt AI Model Workspace (Photobooth)

TET's Cats AI generated art trained on my own art style. Way back in the early 2000's I started painting stylized cat artworks to illustrate some cat themed poems I'd written, that I exhibited and sold online in an exhibition titled 'Sleeping Cats' in 2004. You can see all these early works in my Flickr Album . Many are also available to buy as prints in my RedBubble Store . Leading on from that I began selling my paintings on ebay where the cat themed works were almost guaranteed to sell over any other subject I painted. As a result I became some what known for my cat art to the point where people would commission me to create images of their own pet cats in my cartoony style. Flash forward a decade (almost two at this point) and I haven't painted any cat themed art in years. To be honest I haven't done any traditional painting at all in years. In the last couple of years AI image generators have really caught my attention. Specifically that they are able t...

Is AI Art 'Art'? The Say NO to AI Art Movement, and Why Human Artists Will Adapt

AI Art No T-Shirt by TET Also available on other items . Right now there is a big debate over not just whether AI art is 'art' but whether AI's are actually ripping off the work of actual human artists, without their consent, to create their images - particularly images 'in the style of' specific artists. From my own observations this debate started to get more traction when artist's signatures began appearing in the output of AI Art image generators. Is It Art? Cool Froyd the Cat Sketch by TET. My style is very much influenced by classic Disney and WB character styles. To get some clarity on how real human artists work (of which I am one)... we, that is all of us... take influences from the art that has come before. i.e. whatever artists we like, have studied, seen etc. we are influenced by. It shows up in our work, intentionally or not. If you really study my own cartoony art style you'll see I'm heavily influenced by early Disney and Warner Bros cart...

How to Transfer Any Line Art to Your Griptape - Easy Skateboard Griptape Art Tutorial

Dog Star Griptape Art by TET Griptape art is once again gaining popularity amongst modern skateboarders. For those of us who have tried to create our own griptape art, using paint pens, you'll know reproducing your design onto the grip, without making any mistakes is incredibly challenging. Mostly because you just have to go for it and draw the design freehand, with paint pens, directly onto the griptape. You can make the odd mistake here or there but if you get the proportions of the design completely wrong, it can be very difficult to fix. Often you just have to live with the mistake. To address the problem I've come up with an easy way anyone can transfer a line art design to their griptape, removing almost all the anxiety of getting the proportions wrong. In fact, you could do this with any line art design, even if you have no drawing skill at all. Watch the video below to see my technique in action and/or skip past the video where I highlight the basic steps to get your de...

What If Being Yourself Isn't Good Enough?

One of my most personal public videos is a collection of outtakes edited together with my narration, read word for word, from my blog post written back on August 5th, 2007 titled Is Being Me Good Enough? I made the similarly titled video the next day. At the time the video (which you can view below) generated some discussion in the comments and was a real turning point for me personally in how I thought about myself and how I presented on camera. It took a weight off my shoulders. [Note that especially for this article I've re-edited and re-uploaded the video to Youtube because the last sentence on the original version was cut off by Youtube's uploader. The new version is identical other than I've added a title screen at the beginning and cropped the footage for 16:9 ratio - plus added some length to the end to ensure it doesn't get the last line cut again.] I came to be thinking about this video again because of my latest video diaries - which I will...

Two night Stay Glenelg, South Australia - Glenelg Motel, Beach Front, Cafe Strip/Jetty Road, and Evening Temptation Twilight Cruise

The Glenelg Giant Wheel. T he Glenelg foreshore and Cafe/Shopping strip (Jetty Road) at the end of the tramline from Adelaide, South Australia is arguably one of the must visit tourist regions of the city. It particularly has a lot to offer families with, not just the beach, but quite a number of playgrounds and grassed reserves as well. My partner booked us a post weekend, two night (Sunday and Monday), getaway in Glenelg by way of some discount vouchers she secured as part of a promotion encouraging people to visit the region over the Summer. Glenelg Motel The recently refurbished rooms of the Glenelg Motel raise your expectations from what the exterior of the rooms themselves suggest, which is a very 1970's vibe of your standard motel with parking right outside your front door (and not much else). Our room was spacious, and the modern furnishings were easily to the standards of any hotel we've stayed in over the last few years. The rooms look very modern with everything you...

TET.Life (The Extraordinary Tourist Life)

Search This Blog