campaign_id: null created_at: ‘2026-03-12T23:07:33.545046+00:00’ dashboard_url: https://dashboard.kismetpets.com/context/measurement/1/ experiment_id: 4 id: 1 product_id: null skill: measurement title: Kismet Website Conversion — KPIs, A/B Test Plan & Measurement Framework updated_at: ‘2026-03-12T23:07:33.545058+00:00’
Kismet Website Conversion — KPIs, A/B Test Plan & Measurement Framework
measurement · 2026-03-12
Kismet Website Conversion — Measurement Framework
KPIs, A/B Test Roadmap & Analytics Requirements
1. PRIMARY KPIs
North Star Metric
Website Conversion Rate (Visitor → First Purchase)
- Current baseline: TBD (need analytics access)
- Target: +25-40% relative improvement over 90 days
- Measured as: Unique purchasers / Unique visitors (monthly)
Supporting KPIs
| KPI | Definition | Target Direction | Measurement |
|---|---|---|---|
| Homepage → PDP rate | % of homepage visitors who reach a product page | ↑ Increase | GA4 funnel |
| PDP → ATC rate | % of PDP visitors who add to cart | ↑ Increase | GA4 funnel |
| ATC → Purchase rate | % of add-to-cart who complete purchase | ↑ Increase | GA4 funnel |
| Quiz start rate | % of homepage visitors who start quiz | ↑ Increase | Quiz analytics |
| Quiz completion rate | % of quiz starters who complete all steps | ↑ Increase | Quiz analytics |
| Subscribe vs One-Time mix | % of purchases that are subscriptions | ↑ Increase sub % | Shopify |
| Average Order Value | Revenue per transaction | ↑ Increase | Shopify |
| Bounce rate (homepage) | % single-page sessions from homepage | ↓ Decrease | GA4 |
| Time to first ATC | Seconds from landing to first add-to-cart | ↓ Decrease | GA4 events |
| Email capture rate | % of visitors who submit email (popup + quiz) | ↑ Increase | Klaviyo/quiz tool |
2. A/B TEST ROADMAP
Phase 1: Quick Wins (Weeks 1-2)
Low-effort, high-impact changes that can run simultaneously.
Test 1.1: Static Hero vs. Carousel
- Control: Current 3-slide carousel
- Variant A: Static “Root Cause Fix” hero
- Variant B: Static “Picky Eater” hero
- Variant C: Static “See It In Days” hero
- Primary metric: Homepage → PDP click-through rate
- Secondary: Quiz start rate, bounce rate
- Traffic split: 25/25/25/25
- Min sample: ~4,000 visitors per variant (for 5% MDE at 80% power)
- Expected duration: 2-3 weeks depending on traffic
Test 1.2: Email Popup Timing
- Control: Immediate popup on load
- Variant: 10-second delay + exit-intent
- Primary metric: Email capture rate
- Secondary: Bounce rate, pages per session
- Traffic split: 50/50
- Expected duration: 2 weeks
Test 1.3: Social Proof Strip
- Control: Current (no social proof near hero)
- Variant: Add social proof bar below hero (stars + press logos + guarantee)
- Primary metric: Homepage → PDP rate
- Secondary: Time on page, scroll depth
- Traffic split: 50/50
- Expected duration: 2 weeks
Phase 2: Structural Changes (Weeks 3-6)
Requires dev work. Run sequentially to isolate impact.
Test 2.1: PDP Right Panel Restructure
- Control: Current layout (description first, buy controls below fold)
- Variant: Restructured (one-liner + trust badges + buy controls above fold, description in accordion)
- Primary metric: PDP → ATC rate
- Secondary: Subscribe vs one-time mix, time to ATC
- Traffic split: 50/50
- Expected duration: 3-4 weeks
Test 2.2: Quiz Flow Flip
- Control: Current (email first → dog info → goals)
- Variant: Flipped (dog name → dog info → goals → email gate at results)
- Primary metric: Quiz completion rate
- Secondary: Email capture rate, quiz → purchase rate
- Traffic split: 50/50
- Expected duration: 3-4 weeks
Test 2.3: Homepage Section Reorder
- Control: Current order (hero → press → products → education → …)
- Variant: New order (hero → social proof → education → core products → reviews → …)
- Primary metric: Overall conversion rate
- Secondary: Scroll depth, homepage → PDP rate
- Traffic split: 50/50
- Expected duration: 4 weeks
Phase 3: Optimization (Weeks 7-12)
Iterate on winners from Phase 1-2.
Test 3.1: Price Anchoring
- Variant A: Add “Starting at $31.49/mo” to hero
- Variant B: Add “Fresh food results at kibble prices” + price
- Variant C: Add price comparison vs. Farmer’s Dog / Ollie
- Primary metric: Homepage → ATC rate
Test 3.2: Quiz Results Page Optimization
- Test different recommendation layouts, urgency elements, offer framing
- Primary metric: Quiz → purchase conversion
Test 3.3: Mobile Sticky ATC Bar
- Control: No sticky bar
- Variant: Sticky bottom ATC on mobile PDP
- Primary metric: Mobile PDP → ATC rate
3. ANALYTICS REQUIREMENTS
Events to Track (GA4 + Shopify)
Homepage events:
hero_cta_click(label: quiz / shop_now)social_proof_bar_visible(scroll depth trigger)product_grid_click(product_id, position)quiz_cta_click(location: hero / sticky_bar / section)email_popup_shown,email_popup_submitted,email_popup_dismissed
PDP events:
pdp_view(product_id, source: homepage / quiz / ad / direct)flavor_selected(chicken / salmon)size_selected(4lb / 9lb / 19lb)purchase_type_selected(subscribe / one_time)atc_click(product_id, variant, purchase_type, price)accordion_expanded(section: description / reviews / subscribe_details / giving_back)sticky_atc_click(mobile only)
Quiz events:
quiz_startedquiz_step_completed(step_number, step_name)quiz_email_submittedquiz_completedquiz_recommendation_shown(recommended_product_id)quiz_atc_click(product_id)quiz_abandoned(last_step_completed)
Funnel stages for dashboarding:
- Site visit → 2. Homepage engagement (scroll > 50%) → 3. PDP view → 4. ATC → 5. Checkout initiated → 6. Purchase
Shopify Segments to Create
- Quiz completers who didn’t purchase (retarget)
- Quiz completers who purchased (analyze product match)
- Subscribers vs one-time buyers (LTV comparison)
- Traffic source × conversion rate (ad vs organic vs direct)
4. ESTIMATED IMPACT
Based on industry benchmarks for similar DTC changes:
| Change | Estimated Lift | Confidence | Basis |
|---|---|---|---|
| Static hero (vs carousel) | +10-20% homepage CTR | Medium | Industry data: static heroes consistently outperform carousels |
| Social proof near hero | +5-15% homepage → PDP | Medium | Justuno: 18.29% conversion uplift from social proof placement |
| PDP buy controls above fold | +10-25% PDP → ATC | High | Standard UX finding: reducing clicks-to-purchase increases ATC |
| Quiz flow flip | +30-50% quiz completion | Medium | Lead with investment before gate: standard funnel optimization |
| Price anchoring | +5-10% overall CVR | Low-Medium | Dependent on competitive context and traffic source |
| Popup delay | +/- 5% email capture, -10-20% bounce | Medium | Immediate popups increase bounce; delay trades some captures for engagement |
Combined estimated impact: +20-40% relative improvement in visitor → purchase conversion rate, if all changes test positive and are implemented.
5. TESTING INFRASTRUCTURE NEEDED
- A/B testing tool: Shopify’s native A/B testing, or third-party (Convert.com, VWO, or Optimizely)
- Analytics: GA4 with enhanced ecommerce, Shopify analytics
- Quiz tool analytics: Whatever platform powers the current quiz (likely Octane AI, Typeform, or similar)
- Heatmaps (recommended): Hotjar or Microsoft Clarity for scroll depth + click maps on homepage + PDP
- Session recordings (recommended): Same tool — watch 20-30 sessions per variant to understand qualitative behavior
6. REPORTING CADENCE
| Report | Frequency | Audience | Content |
|---|---|---|---|
| Test status dashboard | Live / daily | Team | Current test status, sample sizes, preliminary results |
| Weekly conversion report | Weekly | Marketing | Funnel metrics, test progress, significant findings |
| Test results + recommendations | Per test completion | Leadership | Winner/loser, confidence level, next steps |
| Monthly conversion review | Monthly | All stakeholders | Overall CVR trend, cumulative impact, roadmap update |
Mentions
- B test (defines)
- Website conversion rate (visitor → first purchase) — north star (defines)