We provide a complete system to help online clothes shoppers visualize how a garment will look on them in 3D. Our system first uses 3D modeling to construct customized body models for online shoppers and fit whichever garments they want to try on the virtual body models.
For each garment size, we use Physically Based Simulation to simulate garment deformation on a set of training body models and apply learning to derive a mathematical deformation rule that characterizes how the garment physically deforms on different body shapes. Given any arbitrary body shape, garment simulation can be easily, instantly and accurately computed using the learned deformation rule.
In order to test our method, we created one extra-large T-shirt and one medium-sized dress. The average time for both T-shirt and dress simulation is less than 2 seconds (not including up-front run-time cost for the learning phase). Besides run time, we also defined and calculated two error measures to compare our results with PBS results quantitatively: 0.56cm and 0.99cm for T-shirt and dress respectively in terms of position and 1.37cm and 2.20cm for T-shirt and dress respectively in terms of shape. The promising experimental results show that the proposed method can achieve garment simulation in real time. The method is also highly scalable and can extend to any type of garment.
We are currently trying to extend our system to more types of garments and to improve the accuracy of garment simulation.
When a registered online customer shops at a fashion company website that uses our software and is willing to try on a garment, our software retrieves the selected garment model in the database and combines the garment model with the customer’s customized body model. In another browser window, the dressed body model of the customer is displayed with realistic details such as garment wrinkles. The customer can rotate the model to see how the garment fits from different views (e.g. front, back and side). Above all, our software serves as a simple plug-in that adds a virtual try-on feature to existing fashion websites and could be easily integrated.