Yes that's right, you need to move the layer if you want to keep the line the same but in a different position.
If you want the line to stay the same but just moved around try the rotate tool.
If you want the line to be curved you may need to use a different tool. Maybe a transform tool.
Always make sure you select the layer you are working on too.
