Do stats like the number of at-bats or the number of walks really count?

Yes. These less glamorous stats are used by Scorecard to determine games. On-base percentage is a major factor in the formula so the number of at-bats, walks, HBP and sacrifices greatly influence that part of the formula.