How about playing it out with Strat-O-Matic football? I loved this as a kid. Anybody still play it?
The Pro Bowl selections, though not perfect, represent a consensus that is weighted 2/3 toward player and coaches opinions. While an AP All-Pro selection is most prized, choosing the between the best vs. second best QB or the 2nd. best vs. 3rd. best cornerback is somewhat arbitrary.
With the Pro Bowl rosters, 6 or 8 QBs and 8 or 10 CBs (after the alternates get named) captures the better players without attempting to split hairs. While there are always a couple of reputational picks made out of habit, the choices are by and large, quite credible. As a consequence, Pro Bowl selections are considered in HOF voting (as already noted) and as a contract incentive on occasion.
It would seem the attempts to discredit the Pro Bowl in these kinds of discussions have as much to do with the Packers not getting many players on the roster in recent years as anything else.