As far as "passion", here is a quote which mentions love but also passion in saying that caution against them is meant to the degree they not keep us from God:
"We must never take one sentence in the Teachings and isolate it from the rest: it does not mean we must not love, but we must reach a spiritual plane where God comes first and great human passions are unable to turn us away from Him. All the time we see people who either through the force of hate or the passionate attachment they have to another person, sacrifice principle or bar themselves from the Path of God."
(From a letter written on behalf of Shoghi Effendi to an individual believer, October 4, 1950; in Lights of Guidance, no. 1341
And while "passion" is used in reference to different kinds of desires, one kind that may be neglected more in modern usage of the word is in the context of a "terrifying sea of passion and desire" spoken in the context of Europe being engulfed in wars where the people and governments of the time wanted to "conquer and crush one another" (from Secret of Divine Civilization
That being said, I think our lack of connection to the negative context of the word is more often because of the fact that our current society has been engrossed in a belief in mostly unmitigated expressions of desire.
Baha'u'llah speaks in the Kitab-i-Aqdas about such desires for absolute "freedom":
"Consider the pettiness of men's minds. They ask for that which injureth them, and cast away the thing that profiteth them. They are, indeed, of those that are far astray. We find some men desiring liberty, and priding themselves therein. Such men are in the depths of ignorance.
"Liberty must, in the end, lead to sedition, whose flames none can quench. Thus warneth you He Who is the Reckoner, the All-Knowing. Know ye that the embodiment of liberty and its symbol is the animal. That which beseemeth man is submission unto such restraints as will protect him from his own ignorance, and guard him against the harm of the mischief-maker. Liberty causeth man to overstep the bounds of propriety, and to infringe on the dignity of his station. It debaseth him to the level of extreme depravity and wickedness."
"Regard men as a flock of sheep that need a shepherd for their protection. This, verily, is the truth, the certain truth. We approve of liberty in certain circumstances, and refuse to sanction it in others. We, verily, are the All-Knowing."