Open Internet by MindsNet

Tuning Optimizers with Extra Internal States

The author struggles with tuning a custom optimizer, Topological Adam, due to its extra internal state and complex interactions. This makes it difficult to control and predict its behavior, leading to inconsistent results. The challenge lies in developing an effective method for tuning such optimizers.

Computing & Technology, Computer Science, Machine Learning