Everytime I would place the bottom-side of a wye track to a bottom-side of another wye track, either wye track would change orientation. I've tried rotating it with a crowbar but to no avail.

So rotate them with a crowbar after placing?

I forgot to mention that rotating with a crowbar doesn't work.

You can do it.

Does this actually work? I expect the switch logic to fail as badly here as it does when you place corners next to switches.