Guilt means you have done something which others don't want you to do. So whenever you are natural you are guilty, and whenever you are not guilty you are unnatural: this is the dilemma, this is the dichotomy, this is the problem.
If you listen to your own naturalness, you feel guilty; then there is misery. You start feeling you have done something wrong. You start hiding; you start defending yourself; you start continuously pretending that you have not done it, and you are afraid — somebody is bound to catch you sooner or later. You will be caught… and anxiety, and guilt, and fear. And you lose all love with life.
Whenever you do something against others, you feel guilty. And whenever you do something that others say, you never feel happy doing it — because it has never been your own thing to do. Between these two is man caught.
OSHO
The Tantra Vision, Vol 1, Chapter #3 ?