Mine is doing this also, but I haven't been able/wanted to go out and freeze while trying to fix it. I usually only start smelling it once the car has started to warm up, but then goes away after it's warm.
Gabe, you are saying to pull the intake and not the manifold, yes?