It should be possible to make a temporary fix, but depends how bad the switch looks like.
It has 2 bent tabs at the bottom. If those tabs are still there and not broken, there is a fix. You need to reassamble the switch and bend the tabs back. Sometimes those bend tabs are not bent properly or they got straight if you hit/put pressure on them (perhaps you drop/hit the remote?)
If not, you could try with a fast curring epoxy. Anyhow the best fix is to replace the switch. It's not expensive, but involves some soldering.