If it really bothers you, try floating an oil absorbing "diaper" off the
transom when you stop.

You'll get some of the petro-chemical residue, but not all of it. Still,
capturing some is better than capturing none.

(If the slick was constant, you'd have to check for leaking fuel)