I am not going to move my temple into the middle of nowhere simply because some people abuse the sanctity of it. It is there for the peaceful worship of my devoted followers, and will remain easily accessible in Central Thakria.
The onus is on you, the mortal, to ensure that you do not breach the trust that we gods have shown in you by allowing you access to our temples.
If you breach this trust, then you will be punished. It is that simple.
As far as I am concerned, a Temple is a legitimate place of refuge in a fight in one circumstance only. If you are attacked without being challenged, DO NOT fight back, and run straight to a Temple, that is fine. Any other situation is abuse.
Since it is hard to prove that you were using the Temple legitimately, don;t use it at all.