The diameter is the main factor of magnitude in the moment of inertia of the section of the handlebar. The moment of inertia is what defines the rigidity of your handlebars - what all riders are looking for, as insufficient stiffness causes dissipation of your precious energy.