The Analytical AI Handbook – Sutro Handbook

Examples Write text/code, generate images/videos, converse with users Classify, extract, judge, normalize, match, score Operational Paradigm Many different user tasks One task, many times Interaction Pattern User-facing, transactional Typically internal data processing & workflows Model Needs Maximum intelligence and size subject to cost constraints Minimum intelligence and size required for accurate task completion Serving & Latency Low-latency, real-time/online High-throughput, batch/offline Determinism Expectations Diverse responses, emergent behavior Consistency, close-to-deterministic behavior User Personas Consumers, Misc. Professionals Data Scientists/Engineers, Ops, Evals, Product Analytics Task Supervision Supervised, interactive Unsupervised Analog OLTP Databases, Web Applications OLAP Databases, Data Pipelines