Spark agents for pipeline debugging at scale, do they work?