New Relic launched New Relic AI monitoring (AIM), the industry's first APM solution for AI-powered applications. New Relic is pioneering AI observability with AIM to provide engineers unprecedented visibility and insights across the AI application stack, making it easier to troubleshoot and optimize their AI applications for performance, quality, cost, and responsible use of AI. With 50+ integrations and features like LLM response tracing and model comparison, AIM helps teams build and run LLM-based applications with confidence.

AI-powered applications introduce new complexity to organizations. AI components like large language models (LLMs) and vector databases are often a black box for engineers, with the potential to provide inaccurate and bias results, introduce security issues, and generate large volumes of telemetry data that need to be tracked and analyzed. AIM solves this by providing end-to-end observability to any AI-powered applications.

Engineers can access a single view to troubleshoot, compare, and optimize different LLM prompts and responses for performance, cost, security, and quality issues including hallucinations, bias, toxicity, and fairness. The trade-off is that AI creates complexity in their tech stack and must be adopted responsibly with security, quality, compliance, and cost top of mind. Applying observability to AI applications is a smart and efficient way to address these complexities so that companies can scale and drive innovation.

Any company that provides these solutions is ultimately enabling organizations to deliver better products and customer experiences. Key features and use cases include: Auto instrumentation: New Relic agents come equipped with all AIM capabilities, including full AI stack visibility, response tracing, model comparison, and more for quick and easy setup. Full AI stack visibility: Holistic view across the application, infrastructure, and the AI layer, including AI metrics like response quality and tokens alongside APM golden signals.

Instantly monitor your AI ecosystem: The most comprehensive solution for monitoring the entire stack of any AI ecosystem with 50+integrations and quickstarts including: Orchestration framework: LangChain, LLM: OpenAI, PaLM2, HuggingFace, Machine learning libraries: Pytorch, TensorFlow, Model serving: Amazon SageMaker, AzureML, Vector databases: Pinecone, Weaviate, Milvus, FAISS, AI infrastructure: Azure, AWS, GCP. AIM is now available in early access to New Relic users across the globe. Users can sign up here to request early access, which is included as a part of New Relic's simplified, consumption based pricing.