Do it! First, it is so much fun. Second, it will improve SOME of your skills. Remember that a BMX track is short, and the intent of getting over some of the small ups is NOT to pedal, but to "pump" over them (thus, the birth of the pump track). I raced BMX a couple of times on my MTB, and had a blast. It does help if you have some rolling sections of trail.
Have fun!
SheFly