Unfortunately with Avalon as in real life you must take the good with the bad.
All the good things and positive experiences about this world, just as in the other, come with an element of risk or more often sacrifice. It is unfortunate that your personal limitations and your client choice - otherworldly concerns - put you at a disadvantage when dealing with the risks of this world.
As to your suggestions of simply avoiding people you dislike through some in game mechanism that eliminates them wholly from your game experience, as much as I sympathize, it is a flawed premise.
Such personal interactions and conflicts are, even for non-combatants, a core part of the experience of life here. Most are able to find ways to make peace with the harsh reality or some way to avoid or overcome their oppressors. Growth comes through conflict and hardship. When these cease to be a part of your existence then growth also ceases.
I would encourage you, however, to take heart. You are not the first to suffer either persecution or physical limitations. Many have overcome these difficulties to leave a legacy and mark of excellence behind them in this world and \"the other\". I hope you will find the strength and ability to do so also - and without the need for a game mechanic that removes all conflict and robs you of the richness of the full gamut of risk, reward, etc involved in the sometimes cruel world of Avalon.
Written by my hand on the 21st of Leaflost, in the year 1257.