I don't use compression for "smoothing out" my playing too often, except with fingerpicking or mellow backing rhythms.
I mostly use it a more of an "effect" rather than a "limiter". Kind of similar to a clean boost that adds sustain and attack, but in a good way.
.
Yeah same situation for me. It really only adds noise and sustain for me, but doesn't really smooth anything out.
As for dirt, is it wrong that I just love a lot of it and a lot feedback?