Open Internet by MindsNet

Implementing CI/CD for Data Science Workflows on Linux-based HPC Clusters

The team lacks automated verification of code changes in their data science workflows, leading to potential breaks in production workflows. They seek practical approaches to implement CI/CD that integrate with their Linux-based HPC infrastructure, GitLab runners, and validate output correctness.

Computing & Technology, Information Technology, Data Science