It's similar to the camera system James Cameron used in Avatar. The physical camera "films" within 3d space and creates a virtual camera shot in a 3d program. This is used in conjunction with motion capture footage applied to a 3d character.
But my question is, could someone use this for live action? Meaning, could I somehow film an actor and get the perfect performance then using the virtual camera, film all the different shots and angles of the scene? The end result not being a 3d character but live action footage.
There is something a *little* like this in development, I seem to recall ti was an MIT thing, but might be wrong ont hat fact. It is a camera that grabs a deep-focus shot at every distance, and you do the adjustment of depth of field and zoom all in post.