Pioneering the use of augmented reality effects on social media, Snapchat recently added two more – lenses that turn ground into bubbling lava or reflective water.
To create such interactive filters, Snapchat utilized a ground segmentation system that uses machine learning. The technique helps the device understand geometry and semantics to separate the ground from other elements in the background. After determining which part of the camera feed is the “ground”, the lenses then allow users to choose between lava or water to fill the area.
Snapchat’s AR lenses have earned praise because these impressively run real-time on user’s camera devices. Currently, the company is collaborating with Verizon to use 5G for advanced AR features.