Snapwear: A Snapchat AR filter for the virtual tryon of real clothes

In this paper, we present Snapwear, a Snapchat AR filter for visualizing real-world clothing in a magic mirror-alike experience with the use of a smartphone. Our objective is to document the steps needed to transform a garment designed for production to be ready-for-use in an AR environment. In this direction, we analyse the generation pipeline of an average avatar, the garment export from the fashion design software, its skinning and rigging to the average avatar and the simulation options offered by Snapchat. Finally, we discuss the AR experience creation process ranging from technical challenges such us body tracking and dealing with occlusions, to enabling the user interaction with the filter.