Is carrying a pack that annoying? I pretty much always ride with a pretty loaded dakine nomad, doesn't bother me.
Kind of like umbrellas and condoms, when you have one you don't need one when you need one you don't have one
Same for me, I ride with a well equipped pack for all rides. For me I like to have a good supply of water, a few snack and enough equipment to fix easy or basic problems.
One other point, similar to what was mentioned by Oldfart, is I like to keep my bike in good shape. A busy schedule means that I don't get out to ride as often as I would like, so I don't like the idea of wrecking a ride for something simple like a flat tire or broken chain due to lack of maintenance is not a good thing.
I also carry a plasma-disintegrater ray gun and zap those broken down on the side of the trail without gear. I kid, I always offer help and have supplied many patches and use of my pump or tire levers when needed. I also carry a decent chain break tool that has been used more than a few times out on the trail.
I think that help is always appreciated, but should not be expected.