" he went insane on me and told me I can’t just expect him to babysit "
as a father myself - YOU DO NOT BABYSIT YOUR OWN CHILDREN
one takes care of their children , one plays and enjoys spending time with one's children , one teaches one's children they are your children!!!