Short field notes on the techniques for composing many small, specialized models into one capable system.
An agent branches off to handle a sub-task, then folds that work back into a short summary — collapsing intermediate steps so its working context stays small.
contextfolding.comCombine several fine-tuned models into one by averaging their weights — composition at the weight level, with no extra training.
soupofexperts.comStack layers from different models into a single new network — no retraining, just surgery on the layer stack.
frankenmerging.comShort, technical field notes on composing small models into capable systems. No spam.