It felt always random where a new window would be opened, turns out it was set to smart_split so it would check where tho mouse cursor is and split to that side. With this change it will always open right/bottom.