Yes, it is common for new plants to have week stalks at first. Loosely support it in some way and get a light fan on it... not enough to blow it over but enough to shake it around a little. It will stiffen up pretty quick. Also, get your light as close as you are able so it wont keep stretching.