t setup, progression and final editing


#1

I know this is a rather broad subject/title, but I wanted to cover as much as I can to be sure that everyone understands what I’m asking. So let’s begin :).

First I have shot this with 2 different cameras, 1) Samsung Galaxy S5 using the Cinema FV-5 with a camera setting of 24fps. I have access to the cmos info if needed. 2) a Toshiba Camelio H30 which shoot 30 fps, and again I do have the cmos info for film back settings.

Ok, first I have storyboarded my concept. The concept/story is this:

Man is sitting at table 3/4 view almost OTS shot. There is a single, object in the center, a holo-projector(3D modelled to be inserted via tracking)((first issue). The man hovers his hand over the projector and as he removes his hand, a 3D curved holo menu comes up. He swipes his palm from left to right and the screen responds by whiping and transforming from left to right. The man sees what he wants, pushes a “holo-picture” of some beverage, and then clicks order and pay.
The screen minimizes in a flash of light that disappears back into the holo-projector. the man looks to his right and a 3d object begins to materializes(a 3d tracker dot was placed here as well as a 3d insert cup with trackers on it. The cup is there the entire shot but will be removed until the “materialization process”, when the 3d modelled cup will take it’s place).
The man picks up the cup, sips, it’s hot he reacts, then sets the coffee back in place…[end scene].

The idea is a single nodal(possible pan) camera shot/setup. I have already shot this sequence but can reshoot if necessary. I set the camera on a tripod and merely shot the action.
I wish to:

  1. replace the walls with 3D modelled-set replacement/extension.
  2. insert the 3D Holoprojector.
  3. insert the 3D Holo Menu at the exact time and remove at the appropriate slot.
  4. finally, remove the hero/stand in cup, and replace with the materialized cup until the final sequence of the shot.

My biggest questions are:

  1. Do i have to have my camera moving in order to replace the 3D scene(obviously to use most tracking software, from what I’m told I need to have a moving camera)?
  2. Would Mocha work for all of this without a moving camera or is the above absolutely necessary for this shot to work?
  3. If I can use a stationary camera, what software would be of use? I have access to Mocha, Syntheyes, Boujou(if needed), Nuke, AE, Maya, Blender, etc.

I have some experience in the various areas but am unsure of the entire process to piece it all together.
There are a billion different tutorials, but nothing specific to what I’m asking.

Hopefully someone can talk me through it :).

Thanks!