Facebook’s new shopping AI knows what exactly you’re looking for

This enables the system to automatically suggest a product’s attributes to Marketplace sellers when they

This enables the system to automatically suggest a product’s attributes to Marketplace sellers when they upload a picture of what they’re trying to list, simplifying the process of posting items for sale. What’s more, it will allow retailers to display their wares in a more natural setting. So rather than listing a dozen catalog items individually, REI for example could instead post an image of a family camping using its products and shoppers would be able to click on each item in that picture to get more information or purchase it on the spot.  

Conversely, it allows buyers to be far more specific about what they’re shopping for than they would otherwise. This comes in handy when you’re looking specifically for a blue suede chaise lounge and not just any blue sofa. It will also allow you to find an exact model based only on a photo of it. So if you see that pair of Yeezys in your feed but don’t know exactly what colorway they are, GrokNet can autonomously scan through the Yeezy store and return the precise product listing, saving you the effort of endlessly trawling the site in hopes of stumbling up on the pair you saw.  According to a Facebook press release, this new system is twice as accurate as its predecessor. 

But as any digital shopper can tell you, products often look and fit slightly differently in real life than as they appeared online. The size and scale of an item can be difficult to discern when looking at it on a monitor rather than holding it in your hands. To help alleviate that, Facebook is also rolling out a feature that allows sellers to generate 3D-like walkarounds of their items using only their smartphones. The seller simply takes a standard video of the item and the system will automatically stitch it together into an interactive, 360-degree view of the object. 

Some retailers, such as Ray Ban and NYX have gone even further and adopted AR to help sell their products. Leveraging Facebook’s existing AR and facial recognition systems, these brands can apply virtual lipstick shades or hover digital sunglasses over the shopper’s face to give them an indication of what they’d look like wearing the product. This system is primarily used by optics and makeup companies right now but Facebook hopes to eventually expand those offerings to include the likes of clothing and home furnishings as well.