Open Internet by MindsNet

Improving Small Code Models' Efficiency and Effectiveness

Current small code models face limitations in inference efficiency and effectiveness, particularly in semantic consistency and generation quality. Despite architectural advancements, data scaling remains a dominant factor in model performance. There is a need for better evaluation methods beyond perplexity for small code models.

Computing & Technology, Computer Science, Artificial Intelligence