Neeral Beladia, Senior Member of Technical Staff at Cohere, presents on lessons learned from building generative AI models for enterprise use cases. This session touches on the ever-evolving competitor landscape, customer tradeoffs, how vital the evaluation pipeline is, and quality over quantity. This session was on the innovators track at Arize:Observe, where attendees explored the real world use cases, challenges in deploying products, and scaling of AI across organizations. This talk was originally given at Arize:Observe at Shack15 on July 11, 2024.