Yes, I understand this fear.
My experience has been that if you "give it a go", you find that it enriches your life. And over time, the more you put into it, the more it continues to enrich the quality of your life.
Even if perfection is not attained... and even if
perfection, in the form of arahantship and nibbana is not possible at all... you will have a mind that is far happier and healthier than the alternative.
Just my take.
"Do not force others, including children, by any means whatsoever, to adopt your views, whether by authority, threat, money, propaganda, or even education." - Ven. Thich Nhat Hanh
"The uprooting of identity is seen by the noble ones as pleasurable; but this contradicts what the whole world sees." (Snp 3.12)
"You've got to focus on what's really worthwhile in life, which means resisting a lot of the currents in our culture" (Thanissaro)