Go for it! (As long as you think you're going to stick with cycling.)

If you have the money it's more than worth it to be on a bike that's comfortable (and you're probably more likely to stick with it if the bike fits).

And just don't tell your friends what it costs- if they're not into cycling they probably haven't ever heard of Serotta and wouldn't have clue that a bike could cost $4000.