Too much endurance?

I’m putting a lot of points into endurance so I can hopefully wear the bull goat armor without being too encumbered, is this something I shouldn’t do and invest in other stats instead? I’m around lvl 180, ng+1, around 80 dex, 50 strength and around 50 vigor and if I’m not mistaken I’m around 95 weight