Open Internet by MindsNet
Measuring SLO for GenAI and Agentic Systems
The challenge involves determining how to effectively measure Service Level Objectives (SLO) for systems that utilize generative AI (GenAI) and agentic systems. This area is considered open ground, indicating a lack of established methods or best practices. The challenge stems from the complexity and novelty of these systems, making it difficult to assess their performance and reliability.
Computing & Technology, Computer Science, Machine Learning