Now live on the Shopify App Store!Install Free

AI Clothing Try-On

AI clothing try-on: how the technology actually works

AI clothing try-on takes two images, a photo of a person and a photo of a garment, and produces a third: that person wearing that garment. The interesting part is not the idea, which is old, but how convincingly the fabric meets the body. That single question separates every AI fashion try-on engine on the market.

This page explains the two approaches in use today, why one of them looks obviously fake on flowing fabrics, and where the technology still falls short. It is written for merchants evaluating clothing try-on AI, not for researchers.

2
Rendering approaches
~8.5s
DrapX generation
1 photo
Shopper input
0
3D models needed

Approach one: overlay compositing

The simpler method cuts the garment out of its product photo, warps it to roughly fit the shape of the person, and pastes it on top. Some tools add a lighting pass or a body-shape estimate to improve the fit, which helps, but the underlying operation is still compositing one image onto another.

Overlays are cheap to run and work acceptably on stiff, boxy garments photographed straight on: a t-shirt, a structured jacket, a hoodie on a standing model. They fall apart on everything else. Because the fabric is not responding to the body underneath it, a dress does not fall, a knit does not cling, and a print does not follow the curve of a shoulder. Shoppers cannot always articulate what is wrong, but they can tell, and a result that reads as fake does not build the confidence to buy.

Approach two: physics simulation

The alternative is to model the garment as a material rather than an image. A physics-enabled engine simulates how that specific fabric behaves under gravity, how far it stretches across the body it has been given, how it folds where the body bends, and how light in the shopper's photo would fall across the resulting surface. This is what DrapX does, and it is why a flowing dress in a DrapX result falls the way a flowing dress falls.

Physics costs more compute per generation, which is why speed and realism usually trade against each other. The engineering work at DrapX has gone into refusing that trade: generations run on dedicated GPU clusters and return in about 8.5 seconds, which is the fastest of any virtual try-on app we are aware of, physics or otherwise.

What the AI has to solve along the way

A usable clothing try-on AI is several models working in sequence, not one. Before anything renders, the system has to find the person in a photo that may be badly cropped, at an angle, or taken in bad light, then infer body geometry and pose, then decide how the garment maps onto that geometry.

  • Detection and alignment: locating the person and auto-cropping to a usable frame.
  • Pose and body estimation: inferring the underlying geometry the garment has to sit on.
  • Garment understanding: separating the item from its product photo, including sleeves, collars, and hems.
  • Material simulation: applying drape, gravity, and stretch to that geometry.
  • Relighting: matching the garment to the light in the shopper's own photo so it does not look pasted in.
  • Texture preservation: keeping weave, print, and stitching detail intact through all of the above.

Where AI clothing try-on still struggles

Being straight about this is more useful than pretending otherwise. Heavily occluded poses, arms crossed over the torso, very low-light input photos, and garments photographed flat rather than on a model are all harder than a clean studio shot. Layered outfits where one item has to sit correctly over another are harder again.

Category coverage is also uneven across the market, including for us. DrapX fully supports tops, dresses, jackets, coats, and full outfits, and is actively expanding to bottoms, swimwear, and accessories. If your catalog is mostly denim or jewelry today, look at what an accessory-focused tool does in the app comparison before assuming any full-body engine is the right fit.

How to evaluate an engine yourself

Do not test with the photo the vendor gives you. Take three garments from your own catalog, one stiff, one flowing, one heavily printed, and run each through every engine on your shortlist using the same shopper photo. Then look at the hem, the shoulder seam, and the way the print bends. That is where compositing gives itself away.

Time it while you are there. Buying intent decays fast, and an engine that produces a beautiful result in 40 seconds converts worse than a good one in 9. Most apps, DrapX included, have a free tier that makes this test cost nothing but ten minutes.

Overlay compositing vs physics simulation

Overlay compositingPhysics simulation
How it worksWarps a garment cut-out onto the photoModels the fabric as a material on inferred body geometry
Stiff garments, straight-onUsually fineFine
Flowing fabricsReads as pasted onFalls and folds naturally
Angled or unusual posesDistorts or misalignsHolds up better
Lighting matchAmbient at bestRelit to the shopper photo
Compute costLowHigh, which is why speed varies so much

Frequently asked questions

The shopper uploads a photo. The system detects and aligns the person, estimates their pose and body geometry, separates the garment from its product photo, and then renders the garment onto that body. How the last step is done is what varies: overlay-based tools composite a warped cut-out onto the image, while physics-based engines like DrapX simulate how the fabric would drape, stretch, and catch light on that specific body.

No. Older virtual try-on systems required a 3D asset per SKU, which is why they never scaled past a handful of products. Modern AI clothing try-on works from your existing 2D product photography, so there is nothing to model, scan, or re-shoot. If a vendor asks for 3D assets or per-SKU manual configuration, factor that labor into the cost.

Accurate enough to change purchase decisions, which is the bar that matters commercially, but it is a visualization rather than a measurement. A try-on shows a shopper how a garment looks on a body like theirs; it does not certify that a size medium will fit. Accuracy is highest on clean, well-lit, straight-on photos and drops on heavily occluded poses or very low light.

The terms are used interchangeably in the market. "Virtual fitting room" usually describes the shopper-facing experience and the returns problem it solves, while "AI clothing try-on" describes the underlying technology. We use both, and the fitting room angle is covered in more depth on our virtual fitting room page.

Tops, dresses, jackets, coats, and full outfits are the strongest categories across the market and are fully supported by DrapX. Bottoms and swimwear are harder and support varies by provider (DrapX is actively expanding into both). Accessories such as jewelry, watches, and eyewear are a different engineering problem entirely, and dedicated AR tools handle those better than full-body engines do.

With DrapX, uploaded and generated images are automatically deleted within 10 days, usually much sooner, and are never sold or used for model training without explicit consent. Try-on is opt-in: nothing is captured unless the shopper actively uploads a photo. Data handling varies significantly between vendors, so read the privacy policy of any app you install.

Related reading

See it on your own garments.

The free plan is permanent and needs no card. Run a flowing dress and a printed shirt through it, then compare against anything else you are considering.