Cohere co-founder Nick Frosst describes the company’s open coding model and the tradeoffs involved in running models locallyA local model runs on computing infrastructure controlled directly by the user rather than only through a remote model service., including hardware and memory constraints. He makes the case for user control and private deploymentData privacy governs how personal, confidential, or sensitive information is collected, used, shared, retained, and protected in AI systems..
Frosst discusses security concerns around open models and argues that access can support defensive research. He also distinguishes capable language tools from human-like intelligence and outlines a possible future of routing tasks between personal devices and larger systemsAI model routing sends each request to a model chosen for that request's complexity, cost, speed, privacy, or other requirements.; these are his assessments and predictions.
Watch on YouTube
