In-Ear Insights: What Are Small Language Models?

In this episode of In-Ear Insights, the Trust Insights podcast, Katie and Chris discuss small language models (SLMs) and how they differ from large language models (LLMs). You will understand the crucial differences between massive large language models and efficient small language models. You’ll discover how combining SLMs with your internal data delivers superior, faster results than using the biggest AI tools. You will learn strategic methods to deploy these faster, cheaper models for mission-critical tasks in your organization. You will identify key strategies to protect sensitive business information using private models that never touch the internet. Watch now to future-proof your AI strategy and start leveraging the power of small, fast models today! Watch the video here: https://youtu.be/XOccpWcI7xk Can’t see anything? Watch it on YouTube here . Listen to the audio here: https://traffic.libsyn.com/inearinsights/tipodcast-what-are-small-language-models.mp3 Download the MP3 audio here . Need help with your company’s data and analytics? Let us know! Join our free Slack group for marketers interested in analytics! [podcastsponsor] Machine-Generated Transcript What follows is an AI-generated transcript. The transcript may contain errors and is not a substitute for listening to the episode. Christopher S. Penn: In this week’s *In-Ear Insights*, let’s talk about small language models. Katie, you recently came across this and you’re like, okay, we’ve heard this before. What did you hear? Katie Robbert: As I mentioned on a previous episode, I was sitting on a panel recently and there was a lot of conversation around what generative AI is. The question came up of what do we see for AI in the next 12 months? Which I kind of hate that because it’s so wide open. But one of the panelists responded that SLMs were going to be the thing. I sat there and I was listening to them explain it and they’re small language models, things that are more privatized, things that you keep locally. I was like, oh, local models, got it. Yeah, that’s already a thing. But I can understand where moving into the next year, there’s probably going to be more of a focus on it. I think that the term local model and small language model in this context was likely being used interchangeably. I don’t believe that they’re the same thing. I thought local model, something you keep literally locally in your environment, doesn’t touch the internet. We’ve done episodes about that which you can catch on our livestream if you go to TrustInsights.ai YouTube, go to the Soap playlist. We have a whole episode about building your own local model and the benefits of it. But the term small language model was one that I’ve heard in passing, but I’ve never really dug deep into it. Chris, in as much as you can, in layman’s terms, what is a small language model as opposed to a large language model, other than— Christopher S. Penn: Is the best description? There is no generally agreed upon definition other than it’s small. All language models are measured in terms of the number of tokens they were trained on and the number of parameters they have. Parameters are basically the number of combinations of tokens that they’v

Listen