It's par for the course with any mind altering substance that you're in the proper headspace to indulge. This means, that if you're feeling any kind of negative emotion, whether it be anxiety, anger, frustration, sadness, etc.—that you reallllly shouldn't be using drugs/alcohol. The numbness will be temporary and when it comes to hallucinogens specifically, it may even alter the quality of the experience, resulting in what is most commonly referred to as a "bad trip".
Personally speaking, due to those aforementioned negative emotions, anxiety specifically, I've never been able to get down with the magic mushrooms. However, according to this year's Global Drug Survey, they're the safest drug you can do. I can't necessarily promote their use, but I will gladly provide some more information.
As per The Guardian—"Of the more than 12,000 people who reported taking psilocybin hallucinogenic mushrooms in 2016, just 0.2% of them said they needed emergency medical treatment – a rate at least five times lower than that for MDMA, LSD and cocaine."
Frankly speaking, it's not all that surprising that MDMA, LSD, and cocaine prove themselves to be more dangerous. Often times when it comes to recreational drug use, it's about people not knowing when "enough is enough." With LSD, you can't always be certain of the dose on the tab. With cocaine, the effects last for such a short time that you think you can do more, and with MDMA do you ever really know what exactly you're taking? How often is what you're sold actually pure?
Be careful though! Just because mushrooms are safer doesn't mean that they don't have harmful potential—"Magic mushrooms aren’t completely harmless, notes Winstock. “Combined use with alcohol and use within risky or unfamiliar settings increase the risks of harm most commonly accidental injury, panic and short lived confusion, disorientation and fears of losing one’s mind.”