Animation project I am working on - Videos

Welcome, Guest. Please login or register.
User ID   P-Word

Secure Sockets Layer Unlimited Web Hosting RSS
Recent Topics
Gallery Latest

78 Views
0 comment(s)

148 Views
0 comment(s)


111 Views
0 comment(s)

413 Views
0 comment(s)


664 Views
0 comment(s)

829 Views
0 comment(s)

Search The Gallery
Welcome, Guest. Please login or register.
September 27, 2021, 07:06:55 AM

Login with username, password and session length
Ai Specific Links


   DatahopaForumCreativityVideoAnimation project I am working on

Pages: [1]
Animation project I am working on
Viewing: 0 Members and 1 Guest       Total Views: 7583

Offline Freddy Topic starter
United Kingdom WWW Administrator
Posts: 6355
Rank: Certified

Animation project I am working on


I posted this at AiDreams but I feel chuffed with myself so thought I would share it here.  Here's the blurb I posted at Dreams...

Got a bit further today. I was up late last night getting my morphing code to be able to combine morphs as I already had single morphs working. And today I finished it off and optimised the code a little bit.

In my code I first load a 'neutral' model/mesh. The morph targets are the same model but in a different shape - eg with one eye closed or smiling. I take the difference between the neutral mesh and the morph target and add that to a buffer (also accounting for the strength of the morph). This is done with each active morph so that you end up with a compound mesh of all morphs then you display it.

I have manual sliders off screen to the left (you can see me mousing them about) . So this morphing is being done live. When a slider changes it changes the weight of the morph or in other words it's level of influence on the neutral mesh.

Cracking the multiple morphs was a really good feeling. I see now how much work has gone into things like Haptek. They were ahead of the game a long time back. But finally years later I have maybe learnt enough to start building my own animation and morphing system.  Cool


Posted December 07, 2013, 20:31:31 PM Logged

Offline sybershot
United States WWW Posts: 1635
Rank: Certified

Re: Animation project I am working on


looks great, keep up the great work.

Posted December 09, 2013, 01:58:12 AM Logged

Offline DaveMorton
United States WWW Global Moderator
Posts: 3413
Rank: Certified
Comfort the Disturbed! Disturb the Comfortable!

Re: Animation project I am working on


I noticed that the morph target limits are such that you can create facial expressions that exceed realism, making the the head a little bit creepy. Not a complaint by any stretch of the imagination here... Just an observation. Smiley Like Syber said, keep it up! thumbsup

Posted December 09, 2013, 04:49:39 AM Logged
Safe, Reliable Insanity, Since 1961!

Offline DD1975
England Posts: 1458
Rank: Certified

Re: Animation project I am working on


Impressive Freddy  thumbsup

Posted December 09, 2013, 09:30:03 AM Logged
Smoke me a Kipper I'll be back for breakfast - Ace Rimmer

Offline Freddy Topic starter
United Kingdom WWW Administrator
Posts: 6355
Rank: Certified

Re: Animation project I am working on


Thanks chaps, that makes me smile as it took me ages to get working and to understand how to do it.

Dave, yes I know what you mean, this was simply an early demonstration of combining facial expressions. Later on I will be adding limits, fade ins and outs as well as durations. These extras should prevent a smile from being too combined with a grimace for example.

In my demo I was combining an angry expression fully with a smile, which is why the mouth went to such extremes. With the idea I envisage this should not happen as a smile will be fading out as she goes into anger, which will fade in. So you won't get two fully weighted morphs at the same time.

Posted December 09, 2013, 14:15:03 PM Logged

Offline DaveMorton
United States WWW Global Moderator
Posts: 3413
Rank: Certified
Comfort the Disturbed! Disturb the Comfortable!

Re: Animation project I am working on


When you're done, will this respond to phonemes from, say, a TTS engine, thus adding voice capabilities? That would be rather cool. Smiley

Posted December 09, 2013, 15:55:34 PM Logged
Safe, Reliable Insanity, Since 1961!

Offline Freddy Topic starter
United Kingdom WWW Administrator
Posts: 6355
Rank: Certified

Re: Animation project I am working on


Yes it will Dave, that's the grand plan. I am working on the in-between morphs at the moment, sometimes called tweening in animation terms. This is being done so morphs change more smoothly between each other.

The reason I am dong this is to give smoother changes in the lips when a phoneme is reached and I show the appropriate viseme.

I've already done tweening before in an XNA project, but this was based on someone else's code.  This time around it's all my code  Cool

Here's where I got to a couple of years back, it's ok, but I did not know what I was doing then really and it only flips through visemes and has no emotion morphs. It did not blend morphs either :


 

Posted December 09, 2013, 19:05:10 PM Logged

Offline Freddy Topic starter
United Kingdom WWW Administrator
Posts: 6355
Rank: Certified

Re: Animation project I am working on


OK here we go, linked to an ALICE bot and with smooth lip-sync. I was up till about 3.00AM working on her lips  Shocked

It was funny because I had my frame rate set really slow so that I did not push it too much.  I had it with about 10 fps and it was terrible and jerky and I was worried .NET could just not handle it. Much to my relief when I tried upping the frame rate to 30fps and then 50fps it all magically slotted into place. A little more tinkering and I was pleased with the results.  For real-time animation it's not too bad.


Posted December 10, 2013, 19:54:23 PM Logged

Offline Snowcrash
England Global Moderator
Posts: 2239
Rank: Certified

Re: Animation project I am working on


That lip sync's pretty good.  thumbsup
Can you delay the sound slightly or is the delay due to processing?

Shame she's got no rhythm.  Grin

Posted December 10, 2013, 20:02:44 PM Logged
“I cannot remember the books I've read any more than the meals I have eaten; even so, they have made me.”

Ralph Waldo Emerson

Offline Freddy Topic starter
United Kingdom WWW Administrator
Posts: 6355
Rank: Certified

Re: Animation project I am working on


Thanks mate Smiley Yeah no rhythm but she knows the good songs !

Delay the sound ? Hmm, do the lips look too slow for the sound to you ? It's certainly something I can tweak. I put settings in for fading in and out of morphs.

Hmm, how to explain it... well for a mouth movement there is a fade in and a fade out duration. I currently have it set at 80 milliseconds each. So that's 160ms per mouth shape change. That's about 6 phonemes a second. At a rough guestimate I think that's the area to be in.

I have a slider where I can increase or decrease this duration, so you can easily find the sweet spot or as good as. That's just where I left it last night after a marathon coding day.

Posted December 10, 2013, 20:08:11 PM Logged

Offline DaveMorton
United States WWW Global Moderator
Posts: 3413
Rank: Certified
Comfort the Disturbed! Disturb the Comfortable!

Re: Animation project I am working on


Well I for one think it was time well spent. Kudos, Freddy! thumbsup

Posted December 11, 2013, 01:05:48 AM Logged
Safe, Reliable Insanity, Since 1961!

Offline GT40
France WWW Posts: 494
Rank: Knight

Re: Animation project I am working on



Impressive...  Cool Cool Cool


Posted December 11, 2013, 08:40:05 AM Logged

Offline Freddy Topic starter
United Kingdom WWW Administrator
Posts: 6355
Rank: Certified

Re: Animation project I am working on


Thanks  Cheesy

Posted December 11, 2013, 15:11:01 PM Logged
Video
Topic Pages: [1]
Find this topic interesting? Register to join in.
Jump to:  

Site Activity
Most Online Today: 169
139 Guests, 1 User
DataBot
Site Activity
Most Online Today: 169
139 Guests, 1 User
DataBot

fast-registration