yes, as he gets older it gets worse. If you dont' want to brush him, take him to a groomer. It can/will get really bad.
Even my short haired cats need some brushing this time of year! i brush pounds of hair off their little bodies.