gwern.net

LLM daydreaming

How default mode networks for LLMs are an example of missing capabilities for search and novelty in contemporary AI systems.