Large language models (LLMs) such as ChatGPT promise advances that extend beyond capturing public interest. Because transformer models like GPT have an architecture that supports the understanding of language in context, they point to an array of novel possibilities for scientific research. “The transformer architecture is critical,” according to Michael Connell, the chief operating officer…