Using deepfake technology to enable virtual makeup testing is now a reality


By AGENCY
Three French students came up with the idea of combining augmented reality with deepfake technology to enhance consumers' online beauty shopping experience. Photo: AFP

Turning consumers into virtual models for an ever more inclusive and personalised online shopping experience is the aim of the project helmed by three French students who won the L'Oreal Brandstorm global innovation competition.

They use a new technique combining augmented reality and the concept of the deepfake to put users at the centre of all online testing sessions, without neglecting the subtleties of skin tone or other characteristics, and all with the most realistic rendering.

The pandemic has clearly changed the game in the beauty world, enabling consumers to enjoy a hybrid experience, both online and in person.

Although they have by no means deserted stores, shoppers can now try out all kinds of new functionalities and new uses offered on e-commerce sites.

These range from skin diagnostics that can be carried out in a matter of minutes, to the 3D printing of personalised vitamins or food supplements, not forgetting the best-known and most popular online experience – virtual makeup testing.

Read more: French luxury fashion group believes the future lies in virtual experiences

Available from a number of cosmetics brands, this virtual reality experience allows users to test all kinds of makeup products online, including foundation, lipstick and eyeshadow.

The technology holds great appeal, although some consumers are (already) complaining about a certain lack of precision, potentially linked to poor lighting or an average-quality camera.

This observation prompted three students from ESSEC business school in Cergy, Val-d'Oise, France to push back the limits of technology to enable as many people as possible to enjoy an online shopping experience combining personalisation, inclusivity and realism.

All this is based on artificial intelligence, through a combination of augmented reality and the art of the deepfake.

Sometimes seen as a threat when misused, sometimes viewed as an incredible innovation, in the case of virtual makeup testing, this kind of hyperrealistic imagery turns the consumer into a virtual model, literally becoming the face of their own beauty needs and preferences.

This is a first that could ultimately shake up industry codes. Plus, it promises no problems with data protection regulations, since only the user will be able to view the rendering.

A hyperrealistic face

More concretely, the "Caring 4 Beauty" project, by French students Inès Flammant, Marie Landrevie and Sophie Martinez, involves using the two aforementioned technologies to enable consumers to upload their photo to e-commerce sites so that their face becomes that of the models they are used to seeing when purchasing a makeup product, all with the most realistic representation.

Thanks to this technique, all skin tones and skin issues or characteristics can be taken into account during an online testing session, without the fear of buying the wrong shade or product range.

Although not yet accessible to consumers, this project won the three young women the international L'Oreal Brandstorm competition, the results of which were announced at the Viva Technology trade show in Paris.

No fewer than 30,000 teams from over 70 countries competed, with just 10 teams remaining in the running for the final.

Read more: Less is more! That's what beauty's new trend, skin streaming, is all about

The prize provides a real springboard for these three students, who now have the opportunity to benefit from three months' support from L'Oreal to develop their project at the group's headquarters.

Although still at the project stage, this innovation based on artificial intelligence could further shake up traditional beauty codes, and enrich consumers' online shopping experience.

And the three winners may not stop there, since they have already thought of improving their concept via machine learning, so that eventually, users will be recommended beauty products according to the characteristics and needs of their previously scanned face. – AFP Relaxnews

Get 20% OFF The Star Digital Access

Monthly Plan

RM 13.90/month

RM 11.12/month

Billed as RM 11.12 for the 1st month, RM 13.90 thereafter.

Best Value

Annual Plan

RM 12.33/month

RM 9.87/month

Billed as RM 118.40 for the 1st year, RM 148 thereafter.

Follow us on our official WhatsApp channel for breaking news alerts and key updates!
beauty , AI , L'Oreal , makeup

Next In Style

Dior versus Chanel: Which fashion house won the celebrity bridal battle?
Framing fashion: Bibo Aswan, the photographer shaping Malaysia's visual style
Has Taylor Swift’s wedding just outshone the Met Gala in fashion stakes?
Fashion awaits Taylor Swift's bridal look, but here's what the guests wore
The American dream, dressed: A look into 250 years of fashion and aspiration
Why letting go of a wedding dress can be among fashion’s hardest choices
Fashion sees clearly as glasses emerge as the chic accessory of the moment
The bikini at 80: Fashion is still pushing the limits of this swimwear classic
Two shirts, one outfit: Is this fashion’s smartest layering trick yet?
A shirtmaker so extraordinary that a luxury fashion house is buying the brand

Others Also Read