Admin: Learning Queue, Benchmarks, Prompts
Learning Queue
Filters: defect/component/inspector/model/accepted-rejected/confidence/date can be layered over these structured columns once volume grows.
| Status | Original Image | AI Result | Inspector Correction | Model/Prompt | Confidence |
|---|
Golden Benchmark Dashboard
Model A
Recall: 81%
False positives: 14%
Average latency: 2800ms
Average cost/image: $0.008
Model B
Recall: 88%
False positives: 9%
Average latency: 4100ms
Average cost/image: $0.021
| Image | Expected | Not Expected | Notes |
|---|
AI Prompts / Version Management
| Name | Version | Purpose | Active | Prompt |
|---|---|---|---|---|
| Inspection Analysis | v1 | Automatic photo analysis | Yes | Return Co-Inspector JSON only; suggestions require inspector verification. |
| Deep Analysis | v1 | Focused finding analysis | Yes | Examine one finding and identify verification steps and uncertainty. |
| Report Narrative | v1 | Inspector-approved customer language | Yes | Generate customer-safe language from approved findings only. Hide AI internals. |
| Relationship Reasoning | v1 | Suggest relationships between findings | Yes | Propose likely whole-house relationships without asserting causation. |
| Ask AI About This | v1 | Field Q&A about a photo | Yes | Answer the inspector question with uncertainty and follow-up photo suggestions. |
Inspection Templates
Standard Residential Inspection
Exterior
Components: siding, trim, grading, walkways
Expected photos: front overview, rear overview, left exterior overview, right exterior overview
Expected checks: grading/drainage, wall cladding, vegetation clearance
Deck
Components: decking, guardrails, stairs, ledger, support posts, post bases
Expected photos: overview, decking, guardrails, stairs, ledger/attachment if visible, support posts, post bases
Expected checks: guards/stairs, visible attachment, supports
Electrical Panel
Components: panel, breakers, grounding/bonding, service conductors
Expected photos: panel overview, manufacturer/data label, breaker area, grounding/bonding observations
Expected checks: clearance, double taps if visible, open knockouts, labeling
Water Heater
Components: tank, data plate, TPR valve, discharge, venting, supply connections
Expected photos: overview, data plate, TPR valve, TPR discharge, venting if applicable, supply connections
Expected checks: leaks/corrosion, TPR discharge, venting, age/capacity
Roof
Components: covering, flashing, penetrations, drainage
Expected photos: roof overview, covering detail, penetrations/flashing, drainage/gutters
Expected checks: damage/wear, flashing, drainage
HVAC
Components: equipment, data plate, condensate, filter, ducts
Expected photos: equipment overview, data plate, condensate, visible duct/venting
Expected checks: operation status, age/capacity, visible installation