Mythologically it is a baby that emerges from the womb already dressed (it is widely accepted knowledge that a dress baby's clothes cannot be changed in utero)
Modern day defines dress baby as a child that annoys you or becomes your responsibility when you have no children of your own present.
We had a great time at the inauguration except for the dress baby at the ball, what were its parents thinking when they brought it along?