you should plug your Rotoshape into the garbage matte input in your Keylight node. Depending on how you created it, you may need to invert it before feeding it into Keylight.
Arnie
Now in post:
Peristroika, a film by Slava Tsukerman
http://www.arniepix.com/blog