The problem is the way signals define a “clear” path. The signals use “path”not “block” based and dependent upon the “line” not the nearest available clear path.
Simply remove one of the signals on the single track lines and that should fix it.
I can go into detail as to what causes this if you want.