Object removal - learning blitz

#1

I am a basic user in nuke who is learning on the fly how to remove an object for a personal project. I’d like to know what the best approach for this footage is (I’m trying to remove a person’s leg). After some research I’m trying out two methods; furnace rig removal and card projection patch.

1.) The furnace node seems the most promising. Simple set up, I rotoed out part of the leg to be used as the source for the rig removal and set the Frame Searches to forward, as that got the best result. It works okay in the beginning, but later there are some outline flickers, misaligned imaging (reminds me of the Ghost in the Shell “optical camouflage” look), and an error at some point. I’ve tweaked the settings all over (even putting very high values), but nothing has worked. What more can I do with this workflow/technique if the furnace node is at its limit?

My rigremoval footage

2.) For a projection patch, I understand the concept, but the times I’ve seen the technique used were on footage that were either static, slight pans, or moving forward with slight rotation. I’m not sure how to start implementing it in this kind of footage not only with that rotation, but also the parallax with the background elements (fence, people, objects, etc.). So far I started off with a camera track and created a 3D scene, but I ran into a mental road block right after that.

#2

I am also a basic Nuke user. If you
need to recreate moving people
behind the leg you’re in trouble.
If you want just landscape and
object then you have to clean a
good frame( in Photoshop) prefe-
rably) and project it( project3d) on
a mesh created by the pointcloud
generator node or with Modelbuilder.
Then you have to matchgrade your
patch with a retimed copy of your
footage or even with the output
of your rigremoval. Actually it is
a bit complex process but works if
you have a good camera solve first.
Now that i see the footage you do
not have enough parallax to solve camera.
Maybe create a clean patch, place it using a 2d
tracker and match it with a manual
cornerpin, noone will notice the difference on this
ground. In anycase forget all the mesh remarks, a
flat card should suffice for projection.
[VIMEO]88269341[/VIMEO]
That is how a quick 2d correction for frames
39-51 would look like( you could apply a corner
pin for the few problematic frames, that is just
a 2 points tracker matchmoving a clean No 46
frame). Remember to use the frame you cleaned
as reference frame of the tracker.