As well as the text in labels, the label itself has settings. With this tab you can control the size and appearance of the label that is created.
There are many settings here so that you should be able to adjust the labels to fit closely to how you want them to appear.
There are also a few settings that control the color and size of the quick label, towards the bottom of the options on this tab.