Person researching products on a laptop with a conversational AI assistant

AskGauge

A conversational AI for TrustGauge, a nonprofit that has tested consumer products for nine decades. AskGauge turns that archive of ratings, reviews, and articles into plain answers and personalized recommendations, in the voice of a TrustGauge expert, in a few seconds.

Scroll
Business Domain
Non-ProfitConsumer Research
Service
Conversational GenAIRAGCustom AI AgentsEvaluation & Guardrails
Technologies
GPT-4oVector SearchPythonFastAPIReactAWS
01 · Overview

Business Overview

TrustGauge is a US nonprofit that has tested and rated consumer products for close to ninety years. Shoppers trust it because it buys what it tests, takes no advertising, and publishes the results without favor. That trust is its whole business, and it sits on an archive of ratings, lab data, and articles that no retailer can match.

The organization's innovation team wanted to put that archive one question away. Imagine typing "I am tall and sleep on my back, which mattress suits me?" and getting a real recommendation grounded in TrustGauge's own testing. They brought in Xpiderz as their development partner for a seven-month build, working as one team with TrustGauge's engineers and product managers to design, build, and launch AskGauge to members in a closed beta.

02 · Challenge

Challenge

A shopper should be able to ask AskGauge a question the way they would ask a knowledgeable friend and get a personal recommendation in the voice of a TrustGauge expert. That sentence hides most of the difficulty. Real questions are vague, mix several needs at once, and use words the lab data never uses.

The system had to work out what a person actually meant, whether they were doing general research, asking about one model, or stuck between two choices, then find the right ratings, articles, and specs across hundreds of product categories and turn them into an answer that is correct, useful, and sounds like TrustGauge. It also had to stay safe in front of the public, refuse harmful requests, and never invent a rating that does not exist.

03 · Solution

Solution

We built AskGauge as a retrieval augmented generation system driven by a custom agent rather than a single prompt. Every question passes through a set of configurable steps: guardrails screen it, a refiner works out the topic and intent, a retrieval layer pulls the matching products, articles, and ratings, and a synthesis step writes the answer in TrustGauge's tone with links to the source pages.

The first version used a general-purpose agent that was easy to maintain but not accurate enough. We replaced it with purpose-built subsystems that can be tuned independently, then ran them in parallel so a fully researched answer still arrives in seconds rather than minutes. Shoppers can ask about a category or a specific model on web and mobile, and every answer links back to the TrustGauge article or rating behind it.

AskGauge shipped with six working parts:

  1. Ground Truth Defined With Experts

    Before writing a prompt, we explored the structure of the archive and worked with TrustGauge's product testers to define the expected answer to a bank of real questions. That set became the yardstick for every later change, so we always knew whether the system was getting better or worse.

  2. Guardrails and an Evaluation Suite

    Layered moderation screens for hate speech, self-harm, sexual content, and violence before a question reaches the model. An automated evaluation suite, plus red-team testing, reruns the full question bank on every change. Guardrail performance improved more than tenfold over the project.

  3. Query Refinement and Routing

    A refiner rewrites the shopper's question and identifies topic and intent, then routes it to the right part of the data. It knows the difference between general research, a question about one model, and a shopper weighing two options, and it learned that from a handful of examples.

  4. Teaching the Model to Read Lab Data

    Ratings for hundreds of categories all measure different things. We built a data pipeline that generates a schema per category and, with TrustGauge's experts, wrote instructions explaining what each feature means to a buyer, so the model interprets a humidistat accuracy score the way a human tester would.

  5. Memory Across the Conversation

    Language models forget the last question on their own. AskGauge started with a short buffer of recent turns and ended with a hybrid memory that keeps both the latest exchanges and long-term context, so "are any of those latex-free?" works after a mattress recommendation.

  6. Fast Answers Under Real Load

    Retrieval and summarization subsystems run in parallel, keeping responses to a few seconds even as accuracy rose. TrustGauge staff and product testers stress-tested the system ahead of launch to confirm it could carry the concurrent load of the beta audience.

Measured Results

The numbers speak

What the seven-month build delivered by the time AskGauge reached beta members.

90yrs Of Testing Data, Searchable by Question Nine decades of ratings, reviews, and articles were vectorized and indexed so a plain-language question finds the right page in one step.
10x Better Guardrail Performance Layered moderation and repeated red-team rounds cut unsafe or off-limits responses by more than an order of magnitude against the launch baseline.
<5s To a Researched Answer Parallel retrieval and summarization keep a fully sourced recommendation within a few seconds, even after the accuracy work made each answer deeper.
100s Of Product Categories Covered A schema-generating pipeline let the model read ratings across hundreds of categories without hand-writing rules for each one.
04 · Collaboration

One Team, Two Logos

This was a joint engineering effort, not a handoff. Xpiderz engineers and TrustGauge engineers reviewed each other's code, ran shared stand-ups, and met several times a week with the innovation lab's leadership, product manager, and project manager to plan research, testing, and delivery. GitHub, Jira, and Slack were the shared workspace.

Design ran the same way. We held review sessions with TrustGauge's design team so AskGauge matched the rest of the brand, and worked with its user research team on rounds of external feedback that shaped both the interface and the model's behavior.

05 · Outcome

Outcome

AskGauge launched to TrustGauge members as an invitation-only beta on web and mobile browsers:

  • Real recommendations, not search results. A member describes their situation in plain words and gets a specific pick, the reasoning behind it, and links to the ratings and articles that back it up.
  • Trust preserved. Every answer is grounded in TrustGauge's own testing. If the archive does not cover a product, AskGauge says so rather than guessing, and harmful or off-topic requests are declined.
  • A foundation that can grow. Coverage is limited to categories TrustGauge experts have examined, and the schema pipeline means new categories can be added without rebuilding the system.
06 · Next Steps

Next Steps

The rollout is deliberately gradual. New members come off the waitlist in waves, each wave feeds the evaluation suite with fresh questions, and the joint team reviews the weak spots before opening the next. Category coverage expands as TrustGauge's testers examine new products, and the same pipeline that reads a mattress rating is already reading cars, appliances, and electronics.

Team
Project ManagerProduct ManagerAI EngineersFull-Stack DeveloperProduct Designer
Tech Stack
GPT-4oVector SearchPythonFastAPIReactAWS

We have spent ninety years earning the right to tell people what to buy. Handing that voice to an AI was the scary part. Xpiderz treated our testers as the source of truth, measured every change against it, and built something our members can ask a real question and trust the answer.

Head of Innovation Lab

TrustGauge

Next Project
Voice AIReal EstateMulti-Tenant

K2X Auto

Multi-tenant AI voice-calling platform automating seller prospecting for Australian real-estate agencies.

Next Project
Marketing AnalyticsDecision IntelligenceAutomation

InsightsBot

AI-powered marketing analytics platform that reduced reporting time by 90% and doubled client capacity.

Next Project
Market IntelligenceCompetitive AIEnterprise

Harbinger AI

Full-spectrum market intelligence platform monitoring competitive signals across six data dimensions.

Next Project
RAG SolutionAI ResearchFull Stack

Sokrateque

AI-powered personal research assistant for Master's and PhD students.

Next Project
AI AssistantWhatsApp IntegrationAutomation

Eona

Conversational AI solution automating customer engagement through WhatsApp in the UAE market.

Next Project
AI Legal TechGenerative AIPlatform

INPRO AI Legal

AI-powered legal consultation platform democratizing access to affordable legal guidance.

Next Project
Legislation AIPolicy DraftingGenerative AI

Legisly

The world's first AI platform for legislative drafting and policy research.

Hive AI
Next Project
Product MarketingDeck DesignAI Canvas

Hive AI

Product marketing deck for YaseenAI's Hive — the AI-powered canvas for work and ideas.

DealerDesk
Next Project
AI ChatbotDealer SupportRAG

DealerDesk

AI support assistant answering dealer install questions in seconds, trained on manuals and years of real tickets.

TalentLoop
Next Project
Recruitment CRMSaaSAutomation

TalentLoop

Cloud-native recruitment CRM unifying matching, scheduling, placements, payroll, and invoicing for a US staffing agency.

CareGraph
Next Project
HealthcareAI AgentsHIPAA

CareGraph

HIPAA-compliant multi-agent clinical assistant giving clinicians patient data and guideline suggestions inside the EHR workflow.

ThreadMind
Next Project
EdTechRAGAI Agents

ThreadMind

Agentic RAG chatbot turning years of scattered Slack logs into a secure, searchable corporate brain for an EdTech company.

FormSense
Next Project
HealthcareAutomationGenerative AI

FormSense

AI document engine reading patient enrollment forms from any manufacturer, cutting processing time by 90% for a US healthcare tech provider.

HazardLens
Next Project
HealthcareGenerative AIPrompt Engineering

HazardLens

AI hazard detection reading camera images from elderly care facilities and flagging risks like water spills with 98% accuracy.

DeskMate
Next Project
AI ChatbotRAGEmployee Support

DeskMate

Secure AI support assistant answering employee questions inside Google Workspace, making ticket resolution 70% faster for a US technology enterprise.

OmniSeek
Next Project
HealthcareAI SearchLLM Development

OmniSeek

All-in-one AI search engine for a healthtech enterprise, searching SQL data, documents, and images in plain English with 90% better relevance.

ModelForge
Next Project
LLM DevelopmentMultimodal AIMLOps

ModelForge

Central AI experimentation platform for a US customer service tech company, making prototyping 40% faster and deployment to production 50% faster.

MindHaven
Next Project
HealthcareAI ChatbotGenerative AI

MindHaven

AI chatbot giving 24/7 mental health support for a US wellness startup, reaching 1000+ users in its first few days after launch.

TrackPilot
Next Project
Voice AIEntertainmentMobile App

TrackPilot

AI voice assistant letting musicians control their studio software by voice and text. The MVP raised investor interest by 65% for a music production startup.

AccrediFlow
Next Project
EducationRAGGenerative AI

AccrediFlow

AI layer writing university accreditation narratives from evidence files with every source cited, cutting preparation time by 90% for a US legal service provider.

DealSight
Next Project
Real EstateMachine LearningMLOps

DealSight

Machine learning underwriting system predicting resale value, rehab cost, and time to sell inside Salesforce, with 31% lower ARV error for a US real estate investor.

HangarIQ
Next Project
AviationRAGAI Assistant

HangarIQ

AI assistant finding past aircraft maintenance fixes in seconds with cited answers. A pilot saw about 30% fewer recurring actuator issues for a US aviation maintenance company.

HireSignal
Next Project
AI AgentsRecruitmentRAG

HireSignal

AI agent automating job postings, candidate targeting, and ad budgets for a recruitment marketing platform, built with LangChain and RAG on Google Cloud.

ClearRoute
Next Project
AI StrategyAutomotiveAdvisory

ClearRoute

AI strategy engagement turning scattered AI experiments into one prioritized roadmap, with governance and an AI Center of Excellence, for a large US automotive services company.