Can you use baby oil as a ual lubricant?

Or can you not because of the fragrance? The fragrance is very light so I'm not sure how much of an irritant it could be...but if it is, could you use pure mineral oil?