Is it really true that the worm in a tequila bottle does more to you thank drinking the actual tequila?

i've heard that it is a hallucinogen and can screw you up worse by just eating the worm instead of straight up drinking tequila.