Open Internet by MindsNet

Limited Domain Adaptation of Large Language Models

Fine-tuning large language models on niche domains like Indian law faces challenges due to limited dataset sizes and hardware constraints. The author encountered issues with cuBLAS on RTX 5090 and had to adapt to a different inference stack.

Computing & Technology, Computer Science, Machine Learning