[Elite Sanctuary Onslaught enemies are not hostlle]

After a few waves of ESO the enemies will stop attacking me, but it doesn't happen every time I run ESO. I still haven't found the cause of this because it happens in solo and in squads, does anyone else have this issue? It takes away the extra challenges of ESO by just having to keep up efficiency and not health.