The fashion designer told a magazine: “If you don’t want your pants pulled about, don’t become a model!”