I agree with whoever said not to try to fall in love with biking. Who knows...maybe it will be your sport, maybe not.
But, I know that I first started riding in order to see if I would like it so that I could share a sport with my then-boyfriend. At first, I had fit issues, and saddle issues, and bike issues, and they did make it less fun. I kept it up because I was motivated to do a sport with him, and also my drive to improve kicked in when I realized I was such a beginner...I like achievement.
Also, I don't know your particular temperament...for me, I have a whole helluva lot more fun once I get a little more competent. I don't enjoy feeling like I don't know what I'm doing, or feeling like I'm unfit at something. I enjoy things more the better I get. Same for biking, for me. I just keep having more and more fun as I get more skills and confidence.
What bothered me when I first started, that kept it from being less fun:
-Lack of confidence around flats and repairs
-Lack of good fit, leading to hand, knee, clitoris soreness
-Uncertainty & fear around hills and traffic (& boredom with bike paths)
-Frustration with beginning level of biking fitness (& related limitations)
Now that I have these things handled, there are some things I love about it, that a person could probably get anywhere, in anything they worked at:
-Setting difficult goals and achieving them
-Wringing every last drop of energy out of my body on a long ride
-Planning, scheming & obsessing for my training and goal-event planning
-A growing sense of mastery, and knowing there is still far to go
-A great community...I am part of a great group of enthusiasts worldwide
-There are super fun, organized events all over the place to give a really fun focus to traveling
And, some things that I love now, biking-specific:
-Really covering some ground...I love that I can go out and do an 80 mile training ride...I mean, I can explore some territory!
-Even fat, like I am now, I can work out HARD and not injure my knee...I have not yet found another exercise I can do for 12-14 hours and not wreck my knee...and I LOVE pushing my body as I get fitter
-I am learning to enjoy speed on the bike (hill descents, tailwind sprints); and as I get fitter, I find it thrilling to feel the speed that my own muscles can produce
-I love learning handling, such as cornering better...I love to drive my car car-and-driver style on mountain roads, etc...and I am enjoying the benefits of proper cornering & acceleration in the same way on my bike for mountain descents, etc. It is a really fun area to build competency.
-I love climbing. I used to fear any little rise, and wonder how I could ever like hill climbing. Now, I deeply enjoy the meditative, rhythmic, breathing-centered activity of a sustained climb. Go figure.
These are just a few things. It must be different for every cyclist, because there are SO many types of riding. Maybe it has something to do with getting past being a beginner so that you can find the kind of riding that suits your personality? Some folks love to race, others solo training, others mountain biking, others social rides, others utility, others track sprints...
"The best rides are the ones where you bite off much more than you can chew, and live through it." ~ Doug Bradbury