Fantasia Barrino has two kids with previous partners ... "I couldn't take her home with me and I couldn't protect her and I couldn't hold her every day — that was hard for me," she said in ...