I'm not sure what you are showing us. Are you saying the drop out section of the swing arm is off relative to the seat stay section? Something like that might cause the pivots to wear faster but I think it is pretty common with some aluminum bikes. And there's not much you could do short of replacing it. You can't cold set aluminum.
Bikes are better now but I recall in the mid 80's a courier came in with a Cannondale which had been nailed by a car. We replaced the bent steel fork and the frame jig tools told us that the seat tube was off by a fair bit, maybe 1cm if I remember correctly relative to the dropouts. The tool for those unfamiliar with it is rested on the headtube and seat tube and an adjustable feeler is set to touch the drop out. Then you reverse it and check the oposite side. A straight frame will of course be symetrical and the tool will align the same on the other side. This one did not and we assumed it had been bent. Well four fit men with l o n g l o n g pipes and hunks of wood attempted to cold set it. Nothing doing. We built it up and test rode it. We could ride no hands without any pulling to one side at all so we surmised that the drops were perfectly square but the seat tube was off.
Debate? Bikes are made for riding not pushing.