Dashboard sprawl was an unfortunate side-effect of running a popular AI-powered messaging service, ASAPP found. (Image: Shutterstock) Observability is critical in a modern technology stack. Engineers need to know exactly what is happening and when, not only to allow expeditious troubleshooting but also so they can spot and act on any anomalies in production systems before they spiral into a catastrophe. As such, even with seemingly every technology product under the sun now boasting some AI capability, it’s still important to have a human in the loop to identify any problems that emerge and decide what needs to be done about them. But humans are complex, too, and it can be difficult for leaders to ensure everyone is seeing the same thing. That was the problem facing ASAPP , a New York-based software firm which offers an AI-based messaging platform for customer contact centres. Its flagship product, ‘GenerativeAgent,’ uses generative AI to interact with end users while retaining that human in the loop to oversee multiple conversations and provide any context or answers the model cannot. That makes for a fairly complex stack, explains ASAPP staff site reliability engineer Pato Arvizu. “You’re talking to an LLM,” says Arvizu, “but […]
K&X Design and Investment Technology, LLC
Invest The Invisible Impact
K&X Design and Investment Technology, LLC
Invest The Invisible Impact
