3D paper man

I've got a project coming up in which the main character is essentially a cardboard cut out. The basic plan was to shoot the actor on green screen and animate him as a 3D layer in After Effects.

I've been using AE for a few years (although still v. 6.5) and have created some pretty advanced 3D scenes (http://www.youtube.com/watch?v=8AxAWRUUHvU) but the problem here is I need to be able to bend, twist and warp the 2D video layer in 3D space. Ideally, I'd also be able to give it a bit of "thickness" as well.

Are there plugins for After Effects which will allow me to do this (still using the comp's lighting and cameras)? Are there features in AE CS3 that would help? Or does anyone know of other software that would be good to use for this type of effect?

Thanks.