Brown and admired

Brown I am and much admired; Many horses have I tired; Tire a horse and worry a man; Tell me this riddle if you can. What am I?