MLSG September - Looped Transformers & World Models

This month, we're covering some of the latest developments in making models better along the road to AGI with new advancements in Transformers and World Models. Talks: "Looped Transformers" - Martin Andrews In his talk, Martin will describe how previous research directions where transformers repeat layers and/or output interim latent states, might be resurfacing in Frontier models. "Can Small Language Models be World Models?" - Dr Tobe Freeman Tobe has been developing a real time inference framework for small, multimodal language models on real-world data. With the right harness, these can be used as precise and performant world models. Tobe originally trained as a neuroscientist at the University of Oxford and still uses this foundational knowledge in day-to-day work as an AI-builder and technology mentor. FOOD UPDATE : Google has told us that there WILL BE pizza at the event --- Talks will start at 7:10pm (entry at 6:45pm) and end at around 9:00pm, at which point attendees can come up to the front for a bit of a chat with each other, and the speakers. Due to some recent security incidents at the venue please take note of the new DevSpace security procedures https://bit.ly/devspace-security Attendees will not be admitted later than 15min after the talks have started. As always, we're actively looking for more speakers - both '30 minutes long-form', and lightning talks. For the lightning talks, we welcome folks to come and talk about something cool they've done with keras, PyTorch, JAX and/or Deep Learning for 5-10mins (so, if you have slides, then max=10). We believe that the key ingredient for the success of a Lightning Talk is simply the cool/interesting factor. It doesn't matter whether you're an expert or an enthusiastic beginner: Given the responses we have had to previous talks, we're sure there are lots of people who would love to hear what you've been playing with. If you're interested in talking, please just introduce yourself to Martin at one of the events.