Trailing Line

I would like to create a trailing line between the 2 points. More precisely, once 1 point is made, a line should be following the mouse until the next click. Once next click is made, that line is being set and another line is being made. 

Issue with this is that I do not know how to remove the lines once they are made on the mouse move. I only need a single line that follows the cursor.