New Way Now: How Arize AI is building a new way to evaluate and observe LLM apps with Google Cloud

With AI playing an increasingly critical role for every organization, it's critical that businesses and their data science teams are equipped with the technologies needed to proactively surface, troubleshoot, and resolve ML model performance issues quickly and accurately. Learn how Arize AI, an AI observability and LLM evaluation platform, partners with Google Cloud to give organizations a whole new way to deploy their gen AI applications successfully using Vertex AI. Arize AI works seamlessly with Google Vertex AI models, offering total visibility into every layer of an LLM-based software system: the application, the prompt, and the response. Teams deploying AI on Google Vertex AI or other Google Cloud ML offerings can easily integrate with Arize. Arize AI’s Co-founder and Chief Product Officer, Aparna Dhinakaran, also also shares how Google Kubernetes Engine (GKE) allows the Arize IT team — a small-but-mighty collective — to easily scale services up or down with demand and provide greater support to Arize developers at scale without getting bogged down with Kubernetes management. “We operate on a very lean operations team and it’s really possible because of GKE — it just works out of the gate.” Dhinakaran says “It helps us scale up, it helps us scale down.” Since October 2021, the startup has significantly expanded its usage of Google Cloud infrastructure and technologies to meet the growing demand for its platform. Running on Google Cloud and leveraging Google Cloud tools – like Cloud Storage to back up its application data, GKE for hosting production environment and infrastructure support, and Google BigQuery – Arize's architecture and platform is built to help teams deploy LLM apps reliably and responsibly. This interview was filmed live at Transform Studio at Google Cloud Next ’23. Join us at the next Transform Studio to feature your organization’s transformation with Google Cloud. Reach out to customerref@google.com. See Aparna speak at Google Cloud Nex