It probably contains magnesium oxide. This common multi-vitamin additive is also used as an antacid and a laxative.
Make sure that you're taking your vitamins with a full meal. This should help reduce the effects. Taking vitamins with food also improves absorption, especially of the fat soluble vitamins A, D, E, and K. More fiber in your diet should help as well. Magnesium draws water from the surrounding tissues by osmosis; fiber will absorb some of this excess water.
Minutus cantorum, minutus balorum,
Minutus carborata descendum pantorum.