Open Internet by MindsNet

Managing Long-Running Preprocessing Jobs at Scale

The poster is seeking advice on how to manage long-running preprocessing jobs at scale, indicating a challenge in handling complex machine learning tasks. They express curiosity about the breaking points of various solutions, such as setup complexity and ongoing maintenance. The poster is looking for insights on what actually works in practice.

Computing & Technology, Computer Science, Machine Learning