Customer Feedback Intelligence System
Created: Feb 17, 2026
Purpose: Automated feedback extraction → structured data → smart routing
Problem Statement
Current state: Customer feedback scattered across emails, support tickets, meeting notes. Manual triage required. Signals get lost.
Desired state: Automated detection, classification, routing. Council sees ops feedback weekly. Dev team sees technical issues pre-meeting. Patterns surface automatically.
System Architecture
1. Input Sources
- Gmail: quan@ztag.com, gantom, quan777 (OAuth ready)
- Zoho Desk: Support tickets (need API auth)
- Future: Fathom meeting transcripts
2. Feedback Detection Layer
LLM-based classifier scans for:
- Feature requests ("wish you had X")
- Bug reports ("Y doesn't work")
- Process friction ("Z was confusing")
- Positive validation ("love that you...")
- Complaints/pain points
Filters out: Orders, confirmations, spam, automated notifications
3. Classification & Enrichment
Type:
- Technical → Dev queue (firmware, hardware, app bugs)
- Operational → Council queue (training, fulfillment, pricing)
- Product → Both (features span ops + dev)
Urgency (1-5):
- 5 = Blocker (system down, safety)
- 4 = High impact (multiple customers)
- 3 = Medium (single customer, workaround exists)
- 2 = Nice-to-have (enhancement)
- 1 = FYI (general feedback)
Frequency tracking:
- Deduplicate similar feedback
- Count occurrences: "Battery complaint #7 this month"
- Pattern detection: "3 districts mentioned same training issue"
Customer context:
- Segment (K-12, mobile operators, FECs, distributors)
- Deal value (high-value customers = higher priority)
- History (repeat feedback vs first time)
4. Storage Options
Option A: Zoho CRM Custom Module (Recommended long-term)
- Native Zoho integration
- Links to Deals/Contacts automatically
- Built-in reporting/dashboards
- Custom fields: type, urgency, frequency, status
Option B: Google Sheet (Quick start)
- Columns: Date | Customer | Source | Type | Urgency | Frequency | Feedback | Status | Notes
- Easy weekly review
- No CRM dependency
- Can migrate later
Option C: Hybrid (Best of both)
- Sheet for immediate visibility (weekly review)
- CRM for long-term tracking + analytics
5. Routing & Notifications
Ops feedback:
- Post to Operations & Process Telegram group
- Weekly digest: "Top 5 ops signals this week"
- Immediate alert if urgency = 5
Technical feedback:
- Post to Development Telegram group
- Pre-Dev meeting summary: "3 bugs, 2 feature requests"
- Link to related Code 5 components
Product feedback:
- Post to Strategy & Vision group
- Cross-domain issues flagged
Data Schema
Feedback Entry:
{
"id": "unique_id",
"date": "2026-02-17T10:30:00Z",
"customer": {
"name": "Millstone K12",
"email": "bmcnamara@millstone.k12.nj.us",
"segment": "K-12 District",
"deal_value": 15000
},
"source": {
"type": "Email",
"id": "gmail:18d9a1b2c3d4e5f6",
"thread_subject": "ZTAG Training Feedback"
},
"classification": {
"type": "Operational",
"category": "Feature Request",
"urgency": 3,
"sentiment": "Positive"
},
"content": {
"summary": "School requests digital lesson plans and wristbands for students",
"raw_text": "[full email quote]",
"keywords": ["lesson plans", "wristbands", "students"]
},
"tracking": {
"frequency": 1,
"similar_count": 7,
"first_seen": "2026-02-17",
"last_seen": "2026-02-17"
},
"routing": {
"assigned_to": "Council",
"status": "New",
"related_system": "Training",
"priority_score": 6.5
},
"resolution": {
"notes": "",
"resolved_date": null,
"outcome": ""
}
}
Implementation Plan
Phase 1: Shadow Mode (Week 1-2)
Goal: Prove detection accuracy
Build:
- Email/ticket scanner (feedback vs noise)
- Classification engine (ops vs technical)
- Urgency/frequency algorithms
- Log to Google Sheet for review
Test:
- Scan last 2 weeks of emails/tickets
- Extract 50 feedback items
- Quan validates accuracy
- Tune classifier based on feedback
Deliverable: Working scanner + 50 validated entries
Timeline: 1 week (aggressive) or 2 weeks (thorough)
Phase 2: Automation (Week 3-4)
Goal: Hands-free operation
Build:
- Zoho CRM custom module setup (if chosen)
- Auto-routing to Telegram groups
- Deduplication logic (merge similar feedback)
- Weekly digest formatting
- Manual override interface (mark as "not feedback")
Test:
- Run live for 1 week
- Monitor false positives/negatives
- Adjust thresholds
Deliverable: Fully automated feedback flow
Timeline: 1-2 weeks
Phase 3: Intelligence Layer (Month 2)
Goal: Surface insights, not just data
Build:
- Pattern detection ("3+ similar = trend")
- Customer segment analysis (K-12 vs mobile operators)
- Impact scoring (high-value customer = boost urgency)
- Pre-meeting briefings (auto-generate agendas)
- Trend reports ("Battery complaints up 40% this month")
Test:
- Weekly Council briefing: "Top patterns this week"
- Dev meeting prep: "Technical feedback summary"
- Monthly review: "What are customers telling us?"
Deliverable: Proactive intelligence, not reactive logging
Timeline: 2-4 weeks
Example Use Cases
Use Case 1: Bug Pattern Detection
Input: 3 emails from different districts mention "wristband won't turn on"
System:
- Detects feedback type: Technical / Bug
- Frequency count: 3 occurrences in 2 weeks
- Urgency: 4 (multiple customers affected)
- Routes to Development group
- Links to Code 5 power management component
- Summary: "Wristband power-on failure reported by 3 districts (2 weeks)"
Action: Dev team investigates before next UTF Labs meeting
Use Case 2: Training Process Improvement
Input: 5 schools mention "lesson plans would help trainers"
System:
- Detects feedback type: Operational / Feature Request
- Frequency count: 5 occurrences in 3 weeks
- Urgency: 3 (nice-to-have, no blocker)
- Routes to Operations & Process group
- Summary: "5 districts requested digital lesson plans for trainers"
Action: Council discusses whether to create training materials (ops decision)
Use Case 3: Positive Validation
Input: School emails "teachers love the engagement data dashboard"
System:
- Detects feedback type: Product / Validation
- Sentiment: Positive
- Urgency: 1 (FYI, keep doing this)
- Routes to Strategy & Vision group
- Summary: "Positive feedback: engagement dashboard well-received"
Action: Reinforce this feature in marketing/training
Questions for Quan
Storage preference:
Review cadence:
Input scope:
Phase 1 timeline:
Integration:
Zoho Desk access:
Technical Notes
Detection algorithm:
- Use LLM (Claude/GPT) to classify email/ticket content
- Prompt engineering: "Is this customer feedback? If yes, classify as Technical/Operational/Product and score urgency 1-5"
- Fallback rules: Keyword detection if LLM unavailable
Deduplication:
- Semantic similarity (embeddings) to group similar feedback
- "Wristband won't charge" + "Battery not charging" = same issue
- Count frequency, surface top patterns
Privacy:
- Customer names/emails stored
- Feedback quotes stored for context
- No PII beyond what's in emails/tickets already
Performance:
- Scan emails/tickets hourly or daily (configurable)
- LLM calls: ~$0.01-0.05 per feedback item (negligible at current volume)
- Storage: ~1MB per 1000 feedback items
Success Metrics
Phase 1 (Accuracy):
- 90%+ detection rate (catches real feedback)
- <10% false positives (marks non-feedback as feedback)
- 85%+ correct classification (ops vs technical)
Phase 2 (Adoption):
- Council references feedback data weekly
- Dev team uses pre-meeting summaries
- Zero manual email triage needed
Phase 3 (Impact):
- 3+ product/ops decisions informed by feedback trends
- Customer retention improved (respond to feedback faster)
- Engineering prioritizes bugs based on frequency data
Next Steps
- Quan: Answer 6 questions above
- Minnie: Build Phase 1 scanner (1-2 weeks based on timeline choice)
- Quan: Validate 50 sample feedback entries
- Minnie: Tune classifier, launch Phase 2 automation
- Team: Start using feedback intelligence in Council + Dev meetings
This is escape velocity in action: AI detects signals → routes to right people → decisions informed by data → Quan freed from manual triage.
Let's build it. 🎯