Vercel’s Harpreet Arora discusses model choice and enterprise usageEnterprise AI is the use of AI systems within organizations under business, security, governance and operational requirements. through the company’s AI Gateway, including its reported growth in open-weight model trafficAn open-weight model makes its trained parameter values available so others can run or adapt it under the release's licence. and spending. He explains how customers may use different models for different tasksAI model routing sends each request to a model chosen for that request's complexity, cost, speed, privacy, or other requirements..
The interview considers token costs, overall usageAI inference economics examines the revenue, cost, utilization, pricing, and margins involved in serving trained models., reliability and security, as well as Arora’s predictions for future model capabilities. Figures reflect the company’s customer base and are not presented as market-wide measurements.
Watch on YouTube
