Why do we need Explainable AI (video)

· Thomas Wood
Why do we need Explainable AI (video)

Your NLP Career Awaits!

Ready to take the next step in your NLP journey? Connect with top employers seeking talent in natural language processing. Discover your dream job!

Find Your Dream Job

Scroll down for video on XAI.

What is explainable AI?

Explainable AI, or XAI, is a set of methods and techniques that allow us to understand how a machine learning model works and why it makes the decisions it does. Without XAI, a machine learning model might be a “black box”, where even the developers cannot understand it they arrived at a certain decision.

Examples of how explainable AI can work

Fast Data Science - London

Need an explainable model?

We can ensure your model is accountable, understandable, and explainable. At Fast Data Science, we like Occam’s Razor! That means we won’t use black boxes such as neural networks unless they are necessary.

Explainable AI techniques can vary. In the case of simple machine learning models like linear regression (formula y = mx + c), it’s easy to understand why a model has made a certain decision because there are only two parameters, the gradient m and the intercept c.

However, for more complex machine learning models, such as deep learning models, convolutional neural networks, and so on, we could have many millions of parameters inside the model and it becomes increasingly harder to understand the decisions made.

Explainable AI for very complex models

Explainable AI techniques in the case of extremely complex models normally consist of introducing small variations, or perturbations, into the input to the model, and observing the changes in the model’s output. For example, if a computer vision model is 87% confident that an image is a cat, and changing one pixel reduces the confidence to 85%, we can conclude that the pixel contained an element of ‘cattiness’ from the point of view of the model. By doing this across the image, we can get a very accurate map of which parts of the image are most cat-like to the model.

The beauty of XAI is that we don’t need to have any understanding of the model architecture to perform this analysis.

There are several well-known frameworks for XAI, the most widely used in Python currently being LIME.

Read more about explainable AI in our earlier blog post on the topic.

Why is Explainable AI important?

There are several reasons why explainable AI is important. First, it can help us to trust and validate machine learning models. If we can understand how a model works, we are more likely to trust its decisions. Second, XAI can help us to identify and correct biases in machine learning models. Third, XAI can help us to explain the decisions of machine learning models to users. This can be important in AI applications such as healthcare, where users need to understand why a model has made a certain decision about their treatment.

In certain fields, there is an advantage in using very simple models such as the APGAR score for assessing a newborn baby’s risk level, which can be worked out on pen and paper. You can find out more in our post on formulas vs intuition in machine learning.

How does Explainable AI work?

There are many different techniques for explainable AI. Some of the most common techniques include:

  • Feature importance: This technique identifies the features that are most important for a machine learning model’s predictions.
  • Local interpretability methods: These methods explain the predictions of a machine learning model for individual data points.
  • Model introspection: This technique allows us to see how a machine learning model makes decisions by examining its internal workings.

How can Fast Data Science help with Explainable AI?

At Fast Data Science, we are experts in explainable AI. We can help you to understand how your machine learning models work and why they make the decisions they do. We can also help you to identify and correct biases in your models, and to explain the decisions of your models to users.

To learn more about explainable AI, or to get help with your own machine learning projects, please contact us today.

Resources

Find Top NLP Talent!

Looking for experts in Natural Language Processing? Post your job openings with us and find your ideal candidate today!

Post a Job

The Impact of AI in the Legal Industry
Ai and societyData science

The Impact of AI in the Legal Industry

We examine the potential influence of machine learning and AI on the legal industry. AI has transformed a number of industries but has not yet had a disruptive impact on the legal industry.

Understanding cities through foot traffic data
Data scienceBig data

Understanding cities through foot traffic data

In today’s hyperconnected world, our smartphones have become inseparable companions, constantly gathering and transmitting data about our whereabouts and movements. This trove of information, often referred to as mobile traffic data, holds a wealth of insights about human behaviour within cities, offering a unique perspective on urban dynamics and patterns of movement.

Harmony reaches final of Wellcome Trust Data Prize
Ai and societyData science

Harmony reaches final of Wellcome Trust Data Prize

We are excited to announce that our data harmonisation project Harmony has reached the final round of the Wellcome Data Prize in Mental Health.

What we can do for you

Transform Unstructured Data into Actionable Insights

Contact us