That's not a stupid question! Dr. Bronner's is made with hemp oil (among other oils).

If it was me, if I'd reacted only to hemp fiber I might try something made with the oil (but I'd borrow some or see if they had a tester at the store, I wouldn't spend the money for a whole bottle if you might be allergic to it). If you've had a reaction to other products made with hemp oil, then soaps probably aren't a good idea.