World models arising in foundation models.
December 20, 2024 — December 20, 2024
approximation
Bayes
generative
language
machine learning
meta learning
Monte Carlo
neural nets
NLP
optimization
probabilistic algorithms
probability
statistics
stringology
time series
Suspiciously similar content
Placeholder, for notes on what kind of world models reside in neural nets.
1 Incoming
2 References
Basu, Grayson, Morrison, et al. 2024. “Understanding Information Storage and Transfer in Multi-Modal Large Language Models.”
Chirimuuta. 2025. “The Prehistory of the Idea That Thinking Is Modelling.” Human Arenas.
Ge, Huang, Zhou, et al. 2024. “WorldGPT: Empowering LLM as Multimodal World Model.” In Proceedings of the 32nd ACM International Conference on Multimedia. MM ’24.
Hao, Gu, Ma, et al. 2023. “Reasoning with Language Model Is Planning with World Model.”
Hu, and Shu. 2023. “Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning.”
Richens, and Everitt. 2024. “Robust Agents Learn Causal World Models.”
Wong, Grand, Lew, et al. 2023. “From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought.”
Yildirim, and Paul. 2024. “From Task Structures to World Models: What Do LLMs Know?” Trends in Cognitive Sciences.