You can rub holes in regular fabric pretty quick with a bicycle saddle.

Dark brown would definitely look bad.... but something that matches the field color of the pattern seems like it would blend OK.