What you wear closest to your body affects the shaping and drape of your clothing.
I recommend a properly fitted bra as the first step for a better fit of your clothing. My latest offerings are from Royce. These bras come in a range of sizes, starting with a 28 band.