AI agents to manage Spark jobs at prod scale, are they worth it?