+972(54) 867-81-80
BrandMeWeb
Tracker
SEO & GEO Visibility3 monthsexpert.yoni1992.co.il

Yoni Expert Case Study — Multimodal Vision AI Diagnostics & Sales

Yoni Expert case study: multimodal Vision AI diagnostics and GPT-4o Vision medical agent driving direct e-commerce conversions with automated Shopify checkout.

Yoni Expert Case Study — Multimodal Vision AI Diagnostics & Sales - Case Study Result Architecture | BrandMeWeb

Key Metric

First
AI beauty diagnosis agent in Israel
3 mo
from idea to production
Photo
diagnosis from a single upload
Direct
Shopify checkout inside the chat

The Challenge

Online buyers were excluded from expert skincare advice, leading to low conversion rates, while generic chatbots failed to provide necessary skincare context.

  • Customers could not get product recommendations without an in-person visit. Online buyers were completely excluded from personalised advice.
  • Generic chatbots could not understand skincare context: fabric texture, skin plane, dryness patterns, pigmentation. Automated advice was useless.
  • There was no way to connect a diagnosis to a product in stock. The customer had to bridge the gap manually, and most did not.

Our Approach

Built Nika Yoni, a custom-branded GPT-4o Vision agent that analyzes skin tone and texture from a photo, instantly matching the diagnosis to Shopify products with direct purchase links.

  1. 1Built Nika Yoni, a custom-branded AI beauty agent deployed on expert.yoni1992.co.il with visual identity matching the Yoni Cosmetica brand.
  2. 2Integrated OpenAI GPT-4o Vision to analyse user-uploaded photos. The agent reads skin tone, texture plane, dryness, pigmentation, and surface condition from a single image.
  3. 3Implemented multi-layer context understanding: fabric structure analysis, surface geometry recognition, contamination mapping. Nika diagnoses the exact microenvironment, not just skin type.
  4. 4Built a vector embedding layer that semantically matches each diagnosis to specific Yoni Cosmetica products. Product-precise, not generic category advice.
  5. 5Embedded direct Shopify Storefront purchase links inside every recommendation. Customer gets personalised advice and clicks straight to checkout without leaving the conversation.

Tech Stack

OpenAI GPT-4o Vision APINext.js 14Shopify Storefront APIVector EmbeddingsCustom Subdomain DeploymentVercel

The Result

Accelerated time-to-market with a 3-month launch. Skyrocketed direct sales conversions from week one by allowing customers to purchase directly from the AI consultation.

What We Delivered

  • Custom AI beauty agent (Nika Yoni) on a branded subdomain
  • GPT-4o Vision analysis: skin, texture plane, fabric, surface, contamination
  • Shopify product recommendation engine with direct checkout links
  • Mobile-optimised conversational UI in Hebrew and English

End-Audience Impact

Skincare shoppers upload a selfie from home and receive an objective, clinical skin diagnostic protocol in seconds, with exact product recommendations ready for 1-click checkout.

Verification & Telemetry Protocol

Empirical telemetry, baseline vs peak performance, and independent verification sources

First Israel AI Multimodal Beauty Agent
Baseline Level (Before)In-Person Clinic Dependency
Zero Online Personal Diagnosis

E-commerce shoppers unable to receive tailored skin assessments; high drop-off on premium cosmetic items.

Verified Peak (After)Multimodal AI Agent (Nika Yoni)
Photo to Checkout in Seconds

Automated photo analysis of skin texture, surface geometry, and direct Shopify checkout links in the chat flow.

Telemetry & Data Source:Shopify Storefront API Telemetry & GPT-4o Vision Diagnostic Evaluation Logs
Audit & Reproducibility Method:Clinical test photo dataset evaluation and end-to-end Storefront API conversion telemetry.

Technical Verification Checkpoints

Sub-5 second multimodal vision analysis deployed on custom domain (expert.yoni1992.co.il)
Semantic vector search linking diagnosis to exact live inventory products
Zero-friction Shopify cart generation embedded natively inside conversation
Full bilingual Hebrew/English responsive conversational experience

Our customers get a personalised diagnosis from a photo and go straight to checkout. Nika understands fabric texture and skin conditions in ways we did not think software could. It changed how we sell.

— Client

Want results like these?

Request a 2-page engineering Term Sheet and fixed-scope quote within 2 hours — zero sales calls.