LittleLearner: Language Models Trained on K-5 Curriculum for Controlled Knowledge Exposure

This research introduces LittleLearner, a language model trained exclusively on K-5 curriculum data to study controlled knowledge acquisition. Experiments show that interventions like scaling and post-training do not improve out-of-scope performance beyond fifth-grade material.

Comments

Read original article