Usually when that happens it's because of how we're sending the click. If you want to click the address bar, you have to actually find the address bar and click that (instead of sending the click to the top level window).
You're going to want to pipe your Select-Window chrome through Select-Control (or Select-Control -recurse) until you get the address bar and then send-click to that (I'd figure out the exact incantation of Select-Control for you, but I don't have Chrome).
As a side note, my preference for stuff like that is to use send-keys ...