Last of us - How are the windows rain drips made?

Hi there community,

I was thinking @Keith maybe you could help me pin point the good person to help me out with this one

There is this effects in last of us of water drips on the windows: https://www.youtube.com/watch?v=GnkQXaJ9AdU&t=277s

The result is awesome and I was wondering how it was made:

-Is it from a sim, if yes, what software?

-Is it a flipbook of one sim only?

-Or is it a composition of multiple sim into one flipbook?

-How is the tail of drips fading out?

It’s more to understand how the behavior was made for it to look like this in the end.

I kind of see a philosophy of, there is droplets appearing and then the drip catch them while sliding and the tail is fading out… But that’s as far as I am right now O_O

Thanks!

4 Likes

A flipbook would yield lowres results for something like this. Set up a mask for the drop path, then scroll at gradient through it. Use the result to generate normals on the fly and you are nearly there. Repeat the texture over the window, with some random offsets or even on particles, if you have the budget.

6 Likes

Houuuu i like those ideas…

You gave me a lot to work on now :smiley: thanks @Partikel

Yup - @Partikel nailed it. We favored doing as much as we could in the shader whenever possible. This was @Eben’s mastery, and comes up in discussion quite a bit. Eben, would you be interested in sharing more details here?

2 Likes

So i guess that once we have our panning material set up we can create like 2-3 meshes with random flow so we could have multiple ‘‘path, shape’’ and we could change the time at which the panning start and we have a lot of different results?!

Yep, that’d work. There are tons of ways to do it.

I’ve used stretched particles attached to the camera for this sort of thing in the past for screen effects. It cost me some cputime, but it reduced the overdraw and I got a whole bunch of randomization options for free. It’s all up to what your needs are.

2 Likes

mayby some fancy RT material - 1 pass to apply gravity and 2nd pass to lightning this. U can use 1 rendertarget for whole scene . just add some offset to uv on every window. ( only if u got tilable RT). That would do it.

I can’t speak to Last of Us, but if you haven’t already check out Sebastien Lagarde’s blog on the rain VFX in Remember Me:

It’s a 7 part blog, and one of the things he covers is exactly this type of effect. I’ve probably referenced this blog a dozen times in the last year.

Edit: Scroll down to the bottom of this page for the part about rain drips on windows: Water drop 2a – Dynamic rain and its effects | Sébastien Lagarde

3 Likes

@Partikel has it right. We didn’t generate the normals, but did a texture sample instead. But you could generate them. And to get variation I just used a UV distortion map. Didn’t use meshes @Alexandre_GM.

6 Likes

Thanks a lot @Eben!

You guys did an amazing work.

I’ll try and keep it simple and now i know exactly where i’m going with this. ^^

shameless plug here but I was experimenting with this just last week :stuck_out_tongue_closed_eyes: https://twitter.com/DeepSpaceBanana/status/873289787704258561

5 Likes

What the magic behind it?

Amazing stuff, Thanks for the sharing the tips to create these effects

It’s the same idea as Z-Aligned Snow, but instead of just using a z-gradient, we use the vertex normals to mask based of the object’s surface slope as well, and use it to blend between world-Aligned patter / streaking.

1 Like

Some time ago i have made Rain Drops FX.

There is 4 things:

  1. Particle systems with random rotation on spawn and color distribution by the mesh lenght
  2. Moveable droplets - height map pictures based on GPU particles and moved down with different speed
  3. Wet layer - UV distortion based on texture
  4. Static droplets - just precomputed normal map

All layers merged to one on final pass and apply to surface.

5 Likes

This video of the Driveclub rain simulation has been posted in the vfx facebook group.
Someone on here who worked on it? How was it done? Is it completely physx simulated?

1 Like

You could get amazing results, a lot better than TLoU, and without any usage of heavy flipbooks, sims, pre-baked or such, check this out:

https://www.youtube.com/watch?v=yNOF7a-qXX4

The thing is, you can always achieve more with a lot less,…always :wink:

-m

3 Likes

It’s not PhysX, but it is a simulation. Fun fact, every car had to be set up by hand because of the different wiper placements, speeds, windscreen shapes and so on.

1 Like

I followed a similar topic about rain drops some time ago on twitter:

2 Likes

I know this is a much older thread but I actually did some tests into a system like this. My solution was to do the calculations in 2D elsewhere then render it to a texture and apply it to the window. Planning on expanding on this in the future to support velocities, etc

1 Like