Is it pretty smooth packed dirt? (not like singletrack and/or full of roots and stuff) If so, even if it's a bit rutted, I would just ride the road bike. Maybe use wider tires for more comfort and a lower PSI if it's bumpy. Packed dirt is pretty pleasant to ride on with a road bike compared to gravel.