PoE Performance Issue

[cJJJJJJ]

Hello, I'm having the issue that im getting terrible fps in the Plains overall especially if alot is going on around me im dropping down to 35-40fps. In all other areas my game is running fine. May somebody got an idea where this issue could come from?

Specs:
i5-6500 
Gtx 1060 6gb
8gb Ram 

When the drops happen im sitting at around 35% GPU usage, 50% CPU usage and 2.7gb Ram usage and temps are all in check.
Changing graphics settings doesnt seem to influence this.
Are there some other settings i could try to change to maybe fix this or is it maybe just due to bad optimisation? :/ 

Any type of help would be much appreciated.

-cJ