Stop by a Joann's or Hancock's or other fabric store and get a seam ripper. Assuming the labels are sewn on, it's the best way to remove them without adding a hole. Since it's not realy ridable this way, what do you have to loose?