New Relic Launches Instant Observability to OpenAI’s GPT-4

Highlights:

• Microsoft Corp. recently announced intentions to integrate ChatGPT with its Bing search engine and made a USD 10 billion investment in OpenAI.
• New Relic’s software lets businesses keep tabs on their DevOps environments, applications, and supporting infrastructure.

New Relic Inc., a provider of observability tooling, recently announced the release of a ground-breaking machine learning operations feature that enables engineering teams to monitor the performance of OpenAI LLC’s GPT-4 efficiently.

A new OpenAI quickstart has been made publically available in the company’s Instant Observability collection of plugins. With only a few lines of code, organizations can monitor OpenAI completion queries while measuring both performance cost metrics in New Relic in real-time. According to the company, its mission is to assist businesses in maximizing the benefits of new artificial intelligence technologies, such as GPT-4, while maintaining a balance between business requirements and expenses.

Companies can purchase software from New Relic to monitor their DevOps environments, applications, and supporting infrastructure. Its Instant Observability product is a library with over 400 quickstarts or prebuilt bundles of observability tools created by specialists and reviewed by New Relic. They enable almost instantaneous observability for any support service or product and may be set up in a few clicks.

The hype surrounding the ChatGPT chatbot, which has shown the amazing powers of generative AI, has increased the need for GPT-4 observability. OpenAI’s ChatGPT can react to nearly any query in a human-like manner. It has shown to be so valuable and realistic — if occasionally incorrect — that Google LLC is gravely concerned it might undermine its monopoly over internet search.

Microsoft Corp. recently announced intentions to integrate ChatGPT with its Bing search engine and made a USD 10 billion investment in OpenAI. Meanwhile, dozens of other businesses have started utilizing OpenAI’s GPT-4 model to generate content and image development, customer care chatbots, and help desk problems.

With more businesses adopting GPT-4, there is an increasing demand for observability tools that may aid in cost- and usage optimization. New Relic is looking to capitalize on this need with a recent release. It states that users may automatically import a monitor module from the nr_openai_monitor package with just two lines of code, providing a basic dashboard displaying different GPT-4 performance parameters. Its capabilities include real-time cost tracking and analytics like average response times and other performance indicators around GPT-4 queries, which can assist teams in utilizing the service more efficiently.

Manav Khurana, chief growth officer and general manager of observability at New Relic, stated that it is an exciting moment for businesses utilizing GPT-4.

Manav Khurana stated, “Observability is a game changer when it comes to helping companies extract value from GPT-4. We are making it so that any engineer using GPT-4 can easily monitor their cost and performance with easy setup and at no cost. This aligns with our mission to put the power of observability into the hands of every engineer.”