Yeasty taste can be from
-sweetening with honey or other high-fructose sweetener
-too much sweetener in the batter
-proofing or raising too long for the ambient temperature
-not enough salt

Personally I like the chewy texture that comes from long (hand) kneading, but it's all a matter of preference. The more you bake, the more you'll figure out what you like.