Skip to main content
Anyscale Endpoints is a service enabling developers to integrate fast, cost-efficient, and scalable large language models (LLMs) into their applications using popular LLM APIs. This Colab notebook walks through how to get started with Anyscale Endpoints and the integration, including:
  • Importing and setting up the Arize client
  • Defining a chat model supported by Anyscale Endpoints
  • Testing LLM responses and logging into Arize
  • Testing LLM chains and agents with Arize integration
Read the full blog post here. Anyscale Endpoints Arize Integration notebook

Google Colaboratory