D&C 130:23; “A man may receive the Holy Ghost, and it may descend upon him and not tarry with him.”

1 Corinthians 6:19; “What? know ye not that your body is the temple of the Holy Ghost which is in you, which ye have of God, and ye are not your own?”

See, I told you so.  The LDS Church does not believe the Holy Ghost will stay with you all the time.