From the course: AI Security and Responsible AI Practices by Pearson

Unlock this course with a free trial

Join today to access over 26,400 courses taught by industry experts.

Delving into large language models (LLMs)

Delving into large language models (LLMs)

From the course: AI Security and Responsible AI Practices by Pearson

Start my 1-month free trial Buy for my team

Delving into large language models (LLMs)

“

In this section we're going to be talking about the large language models in more detail. Large language models are part of generative AI. Here I have prepared a diagram that is going to help us view some of the process and then we're going to get into the details of each step. One of the more important things in developing large language models is that we need to have a very strong training data set and that training data need to include diverse text data sets. This is part of the transformer architecture which has only recently emerged since the last few years and it has made already significant changes in our society. Transformer architecture requires self-attention mechanism to assess the capabilities but also this kind of technologies they have various challenges and limitations associated with the technology and now we're going to go into some of those challenges and limitations. But first let's just discuss what are large language models. Large language models use deep…

Contents