If memory serves me correctly (which it rarely does), the movie was "Eldorado" and the line was delivered, twice, by Robert Mitchum. I especially enjoyed its delivery, right before he busted Ed Asner across the face.
Did I mention that I believe Edward Asner was a talentless bum with the intellect of an aphid?