The Go button is controlled by peshell.exe. You can try renaming peshell.exe, but be warned, there may be other dependencies that you are breaking.
Short answer is no you cant remove it, but you can try this. It might work.
That worked! I also had to remove the WINPESHL.INI file as well. Sweet deal.
Note: The reboot command requires the shell.. Not sure if adding something like sysinternals shutdown command will help...