My allergies are terrible on days that it rains, am I allergic to mold or mildew?

Anything else it could be other than mold and mildew? I take an allergy pill and it doesn't even help on rainy days, i have a hard time functioning.