That's where contact highs come into play though, it's not supposed to be from second hand smoke necessarily but from being around someone that is high and you get on the same wavelength as them.
From Wiki
Although since it has citations needed in there thats probably stuff people added on their own opinion. So it's just what i've head not what i've experienced.Contact high is a phenomenon that sometimes occurs in people and animals who come into contact with someone who is under the influence of drugs. It involves a supposed transfer of the psychological state of highness. This is often attributed to things such as stale latent cannabis smoke and transcutaneous transfer of psychoactive chemicals.[citation needed] However, this may be better explained by the subconscious picking up on the user's "vibe" and sociological factors.[citation needed] A glossary of drug users' language from the 1970s describes the term as "a psychogenic “trip” without taking drugs by being close to somebody while he is on drugs. It is incorrect to use it for the high obtained by inhaling the smoke of other marijuana smokers."[1]