Is it at the seam or in the fabric?

Either way I would repair it. It will begin to unravel and become bigger. Assuming it is a tightly knitted fabric, Stitch it from the inside. You MAY wish to treat it with a drop of Fraycheck which you can get at a fabric store. It will result in a touch of stiffness though.

Glad you're OK