Well the answer all depends on what you are good at.

For example, I am a strong swimmer. I could swim maybe 2 times a month and keep my fitness level up. I am a weak runner though. If I let my miles drop or if I stop running, it takes me a long time to get back my fitness.

So, what is your strong point? Did it take you a fair amount of time to get good at either of those?