You click to select single values/data points, one at a time. If you want to deselect a value/data point, click it.