Click LMB on Delete Spline Point (X) and then Click LMB on a white spline circle to remove unwanted spline points. You cannot delete an end spline point, but you can delete the whole section using the Delete Spline (D) tool.