You may have a fundamental problem trying to key material that has been originated on DVCam.
Both DV and DVCam use 4:1:1 chroma subsampling and although DVcam usually has s slightly better picture quality than DV, as the cameras and lenses are a little better quality the 4:1:1 signal makes keying poor.
Recapturing from the original may help a little but broadly there is not enough colour information to provide a clean key with that format.
best wishes
Neil
http://www.patience.tv