By adding a point to the expression list, you'll automatically have the option to add a label. Enabling the checkbox without adding text will automatically show the coordinates of the point on the graph paper.
To create a text label, make sure the "Show Label" checkbox is enabled and type in the text of your choice. The graph paper will automatically update. It's also possible to create labels on movable points.