Yoni Expert – Multimodal Vision AI Diagnostics
Drove direct e-commerce sales by launching the first AI beauty agent in Israel, linking photo analysis directly to Shopify checkout.
Key Metric
The Challenge
Online buyers were excluded from expert skincare advice, leading to low conversion rates, while generic chatbots failed to provide necessary skincare context.
- Customers could not get product recommendations without an in-person visit. Online buyers were completely excluded from personalised advice.
- Generic chatbots could not understand skincare context: fabric texture, skin plane, dryness patterns, pigmentation. Automated advice was useless.
- There was no way to connect a diagnosis to a product in stock. The customer had to bridge the gap manually, and most did not.
Our Approach
Built Nika Yoni, a custom-branded GPT-4o Vision agent that analyzes skin tone and texture from a photo, instantly matching the diagnosis to Shopify products with direct purchase links.
- 1Built Nika Yoni, a custom-branded AI beauty agent deployed on expert.yoni1992.co.il with visual identity matching the Yoni Cosmetica brand.
- 2Integrated OpenAI GPT-4o Vision to analyse user-uploaded photos. The agent reads skin tone, texture plane, dryness, pigmentation, and surface condition from a single image.
- 3Implemented multi-layer context understanding: fabric structure analysis, surface geometry recognition, contamination mapping. Nika diagnoses the exact microenvironment, not just skin type.
- 4Built a vector embedding layer that semantically matches each diagnosis to specific Yoni Cosmetica products. Product-precise, not generic category advice.
- 5Embedded direct Shopify Storefront purchase links inside every recommendation. Customer gets personalised advice and clicks straight to checkout without leaving the conversation.
Tech Stack
The Result
Accelerated time-to-market with a 3-month launch. Skyrocketed direct sales conversions from week one by allowing customers to purchase directly from the AI consultation.
What We Delivered
- Custom AI beauty agent (Nika Yoni) on a branded subdomain
- GPT-4o Vision analysis: skin, texture plane, fabric, surface, contamination
- Shopify product recommendation engine with direct checkout links
- Mobile-optimised conversational UI in Hebrew and English
Our customers get a personalised diagnosis from a photo and go straight to checkout. Nika understands fabric texture and skin conditions in ways we did not think software could. It changed how we sell.