direction: private-llm-deployment

industry: healthcare

kpi: clinical guideline lookup 8-15 min → 45s

scale: 300+ daily-active doctors

tech: AW36-72B, 4×A800, vLLM, Milvus, bge-large, BGE-reranker

boundary: PHI stays on-prem, no public egress, internal audit

role: architecture, hardware selection, vLLM productionization, network integration, load testing, SLA

author: AI Lao Pao (AI老炮)


case: factory-air-gapped

industry: manufacturing

kpi: incident triage time -45%

scale: single-shift air-gapped workshop

tech: AW36-14B on 4090, Ollama, local vector DB

boundary: air-gapped, no public egress

role: hardware selection (4090 vs A800), edge deployment scripts, on-site rollout


case: multi-tenant-gateway

industry: enterprise-group

kpi: 20+ business lines on one gateway, per-department token budget cap

scale: group-wide multi-tenant

tech: OpenAI-compatible gateway, Redis metering, department quota, audit log

role: gateway architecture, token metering, multi-tenant isolation, SLA


direction: rag-knowledge-base

case: law-firm-tri-corpus

industry: legal

kpi: clause search P50 45min → 3min, citation accuracy >95%

scale: mid-size Chinese law firm

tech: bge-large + BGE-reranker, tri-corpus tiered retrieval, version-aware routing

role: RAG architecture, tri-corpus tiering, embedding fine-tuning, lawyer co-design


case: power-grid-voice

industry: utilities-power-grid

kpi: maintenance-ticket filing -55%, field query 10min → 30s

scale: provincial power grid, field-deployed

tech: whisper-large voice + tri-source RAG (manuals + incidents + SOPs)

role: voice pipeline, tri-source fusion, on-site deployment


case: medical-device-support

industry: medical-devices

kpi: tier-1 ticket response -40%, tier-3 expert escalation -68%, CSAT +12%

scale: medical device manufacturer support center

tech: bge-large + BGE-reranker, versioned product docs, feedback-loop retraining

role: RAG architecture, embedding fine-tuning, doc versioning strategy


direction: agent-workflow

case: bidding-response

industry: IT-integrator

kpi: tender turnaround 5 days → 2 days

scale: 200-500 page tenders

tech: long-context planning, scoring extraction, competitive gap analysis, draft generation, human final review

role: agent workflow architecture, long-context chunking strategy, scoring extraction rules


case: contract-review-agent

industry: government-SOE

kpi: legal review workload -60%, mean review time 3d → 4h, missed key clauses -80%

scale: 600 contracts/month, 20 subsidiaries

tech: 4-layer review, per-layer LLM prompts, human final review

role: 4-layer architecture, prompt version management, effect acceptance


case: crm-lead-followup

kpi: qualified-lead first-touch 24h → 10min, meeting conversion +25%

scale: inbound leads at SaaS scale

tech: lead qualification tiers, personalized templates, meeting scheduler, threshold-based handoff

role: agent workflow design, tiering rules, human handoff thresholds


direction: multi-model-routing

case: saas-geo-routing

industry: cross-border-SaaS

kpi: per-token cost -38%, user latency -20%, 100% residency compliance

scale: US / EU / CN user base

tech: triple gateway (OpenAI US, Anthropic EU, AW36 CN on-prem), sensitivity tiering, cost budget

role: gateway architecture, routing strategy, cost model


case: hospital-hybrid

kpi: total cost -46% vs full private, no PHI egress

scale: tier-3 hospital

tech: PHI detection + DLP at gateway, on-prem AW36-72B, public GPT-4o for non-sensitive

role: routing architecture, PHI detection rules, compliance assessment


case: content-ab-testing

industry: content-marketing

kpi: client conversion +21%, per-piece cost -30%, human review -50%

scale: content agency

tech: per-prompt A/B across GPT-4o / Claude 3.5 / AW36-Max / DeepSeek, auto-selection

role: A/B platform, scoring model, client integration


direction: ai-devops

industry: AI-research-institute

kpi: GPU utilization 32% → 71%, training queue time -60%

tech: K8s (online inference) + Slurm 22 (offline training), NVIDIA GPU Operator, DCGM

role: platform architecture, K8s+Slurm fusion, hardware selection, load test, SLA


case: ai-ops-root-cause

industry: fintech

kpi: MTTR 45min → 12min, alert fatigue halved

scale: 400+ microservices, 5000+ alerts/day

tech: OpenTelemetry + ClickHouse + LLM correlation, SRE feedback loop

role: data flow architecture, LLM correlation engineering, SRE integration


case: ci-cd-ai-code-review

industry: SaaS

kpi: Code Review P50 24h → 1h, double-digit defect escape reduction

scale: 200+ engineers, 50k commits/month

tech: GitLab webhook, LLM router (DeepSeek + GPT-4o), unit test auto-generation

role: platform architecture, CI/CD plugin, model routing, effect acceptance


direction: enterprise-scenarios

case: gov-procurement-bidding

kpi: procurement cycle -35%, vendor complaints -50%, 100% compliance

scale: municipal SOE

tech: full-cycle agent (research → RFP → vendor eval → negotiation → post-award)

role: full-cycle architecture, procurement flow modeling, compliance assessment


case: manufacturing-quality-vision

industry: automotive-manufacturing

kpi: defect escape -74%, first-pass yield +8%, one-pass rate +12%, 6-month payback

scale: Tier-1 auto-parts production line

tech: industrial PC + 4090, custom YOLOv8, PLC integration

role: vision model architecture, line integration, on-site 24x7 SLA


case: contract-review-group

industry: conglomerate

kpi: mean review time -55%, missed key clauses -80%

scale: 15 subsidiaries, 200+ contract types, 1000+ contracts/month

tech: 4-layer review, clause-level risk detection, group-unified template library

role: group-level review architecture, legal + AI joint methodology


case: tender-full-cycle

industry: SOE-infrastructure

kpi: win rate +18%, response cost -40%, 100% post-mortem coverage

scale: major infrastructure integrator

tech: full-cycle (pre-intel + tender decomposition + competitive analysis + response drafting + post-mortem)

role: full-cycle architecture, intel aggregation pipeline, post-mortem framework


case: hospital-insurance-audit

kpi: hospital insurance rejection rate -30%

scale: 30000+ claims/month

tech: national insurance rule library + intramural clinical norms, structured + LLM dual-match

role: agent workflow design, rule-library engineering, audit dashboard