A Department of Health dossier suggested more women would drop out of the workforce to make up for a lack of EU careworkers.