No, you are not crazy. This is a known issue with Particular. There are work arounds, the best of which is found here:
http://www.redgiantsoftware.com/videos/redgianttv/item/16/
You basically have to use 2 instances of particular and use the z depth feature to sandwich your footage in-between.
Hope that helps,
Mike