Angelina Jolie is in danger of losing primary custody of her six children to estranged husband Brad Pitt