Graphs for Causal AI

Key Takeaways

[Music] You're listening to data skeptic graphs and networks the podcast exploring how the graph data structure has an impact in science industry and elsewhere. I'm sorry you know to uh redirect but I think we have something important to talk about and we forgot that we forgot to mention. Yeah. is that uh I think you you should say habus papam we have a new pope the reason I mentioned it is because there was kind of a prediction here based on network science on who who would be the next pope fascinating tell me more a day before the pope was chosen a research team from Italy University of Bakoni they published a cardinal network or a Vatican network you can say from uh they used three main sources they used the who ordained whom okay because there's a kind of patronage system there and official co-membership in the church institutions and uh informal relationships like both were mentioned on an article or something like that. So they uh defined three criteria of uh prominence for for the cardinals like they used status that they measured by using vector centrality and uh I think we mentioned it but I en vector centrality is centrality that you get a high score if you are related or you are in the neighborhood of a node with a high degree. They use like information control and for that they used the between centrality to measure how much the node bridges between sides of the network and they used the cardinal's ability they try to measure the cardinal's ability to build coalitions by using the local clustering coefficient. So how many triads of the neighborhood in the neighborhood of the node are closed right? So they used these uh three measures and the article was like a day before and they found out that Robert Prevost the or should I say Leo the 14th had the highest IE vector IE vector centrality in the in the network. I wish I would have known this before. I would have put some money on him. Yeah. But fascinating. Did they explore if that technique could have predicted previous popes? Oo great question. But the reason I know they didn't or the reason I guess the u you know it it got traction is uh because it uh succeeded right we if if it sure you know if if it didn't succeed there were 10 other papers predicting it with other methods where it didn't work and we don't know I'm sure there was I I'm sure they were well it's great to know that they uh reverse engineered the great papal algorithm right don't the Cardinals go into the room and run some software and that's how they decide the machine overheats and the black smoke comes out. The white smoke. Ah, well, that's once it succeeds. Yeah. Yeah, exactly. Well, I I'm glad that was resolved. Then they have a new leader and network science predicted it. So, be interesting to follow the the next round of this and uh see if the same techniques can yield a fruitful prediction. I wish Leo the 14th a long long life and healthy and long life. People are pointing out that he's a Chicago like myself. So, that's interesting. Anyway, today we're getting into a topic we've touched on before, which is knowledge graphs, but I think in a new context and tie into issues of causality and basian reasoning and these sorts of things. Assaf, what did you think of the paper we're going to discuss today? Actually, it was uh very interesting, but um you know, you don't have to convince me that networks help to you know, explain stuff, right? So the whole idea behind modeling our data as a network is to simplify, understand and explain the data. Right. Sure. But when you when I think of a knowledge graph, well actually first aside from my notes, one of the interesting insights she shares is that knowledge graphs are inherently incomplete. There's always a link missing, right? We don't know the full breadth of all knowledge. Uh and that I guess ties into the backdoor path aspects of their work we're going to get into. But more centered at that is the causality issues. They take a knowledge graph and get into causal ontologies and how they can map basian knowledge graphs to an embedding space. So a lot of good buzzwords for the modern era. Indeed. My name is Utkari Germany and I'm currently a grad student at University of South Carolina at artificial intelligence institute. This is my last semester. I'm graduating in summer and I'm hoping to be an assistant professor in a university pretty soon in fall. Can you share a few details on what you're studying? What's the research you're doing in grad school? I work on causal neurosymbolic AI which lies at the intersection of both causality and neurosymbolic AI. And my goal in research and uh other areas is how do I make artificial intelligence more explainable to people? Can we do causality? So we as humans understand cause and effect but these AI systems do not. They're mostly learning based on correlations or statistical relation. So I want the AI systems to learn humanlike causal understanding or humanlike causal reasoning. So that's my goal for the AGI. Why does statistics fall short? We know software is really good at doing statistics and statistics can find correlation. What else do we need? It doesn't do causation. I'm sure people have heard about spurious correlations where we see relations from ice cream sales go up and there are more likely people are dying. So statistics at uh that stage leads to these type of analysis or relations that higher ice cream sale leads to higher people more people drowning in pool or let's say at the ocean. But we need to go into what is the cause behind it. There are safety critical applications of AI such as healthcare. We don't want to just rely on correlation. Let's say you're more cor there's a disease which has higher correlation with the symptom. You don't want to see say that this is the cause but it's not just it's not a cause it's just this one statistical relation that you have learned it's it is just correlation and if we think about using AI in these safety critical applications such as healthcare or industrial manufacturing or autonomous driving we want to move a step further into causation because if we make a wrong claim there's a human life at stake in the statistics physics world we've got standard method everybody knows the t test and the kaiquare test and these sorts of things are there established methodologies for examining causality so the t test the independence test they are a good uh predictor for how likely something could be a possible cause and we do have uh similar criterias in causality so I follow uh Udapole's uh philosophy of do calculus So in those domains we have something called as intervention and to measure the effect of interventions there are three parameters such as total causal effect which figures out or which estimates the intervention to the treatment variable and in see how it does how does it affects the outcome variable. Similarly if there's a mediator involved so think about as a serial chain. So A causes B causes C B is a mediator. So now you want to estimate how does the effect of this mediator influence the causal relation from A to C. So for that we have two different types of effect estimation. Causal direct effect and causal indirect effects. So those would be three I would say variables or um estimates in causality. Well, I'm pretty familiar with certain symbolic techniques like the historical ones, maybe first order logic and this kind of stuff, but you said specifically neurosymbolic. How does it differ? So, basically neurosymbolic deals with yes, we do have logics in that and when I deal talk about neurosymbolic, I'm talking about knowledge graphs in specific. So, everything is in the form of a triple. The link from A to B is a s is a triple and a knowledge graph represented using RDF or description logic if you want to use that. There are different types of uh knowledge graphs. So people have used labelled property graphs. My research deals with the triple based knowledge graph or RDF and RDF star knowledge graphs. So everything in that sense would be so it would be in the form of a triple A causes B. That's the symbolic part of neurosymbolic AI. That's the knowledge graph. And we transform this knowledge graph into a vector space or in an embedding space. So every node would be represented or every relation would be represented as a vector and that becomes the neuro part of it. And combining those two becomes the neuro symbolic. So now once you have converted this knowledge graph into the vector space now you can do certain AI applications or downstream tasks such as link prediction. So given this link or partial link of A causes I want to predict what does A causes? Does it A causes B? Does A causees some other node C or D for example? Then some other task that could be done as clustering. So cluster similar nodes in the knowledge graph together or classify nodes in the knowledge graph together. Well, I hope most listeners will be familiar with text embeddings like uh what goes on behind the scenes in large language models. You give it some text, you get a similar vector out. And that vector represents, you know, has these spooky properties, you know, king minus man plus woman equals queen kind of stuff. There's context to it. Are there equivalents that you find in the embeddings you do or are there nuances to that process to get a proper knowledge graph embedding? In today's datadriven world, the ability to extract value from data isn't just an advantage, it's essential. Mastering analytics can transform both your career and the organization you work for. It's your turn to transform your career and drive organizational success through analytics. Let me tell you about the Sheller College of Businesses Business Analytics Graduate Certificate at Georgia Tech. It's 100% online. Sheller College ranks in the top 10 US business schools for busy business analytics professionals. They have a world-class faculty that can help you graduate in as little as a year. But maybe you're busy like me and you want to take it a little slower. You can combine flexibility with rigorous education. Sheller's graduate certificate program adapts to your life, not the other way around. Their program is designed for professionals like us who want to leverage data and solve real world business challenges, but need flexibility with their time and schedule. That's why you can schedule your classes in a way that makes sense to you. On top of that, you're not just earning a certificate. You're potentially opening doors to Georgia Tech's prestigious MBA programs. Now is the time to become a data savvy leader with Georgia Tech's business analytics graduate certificate. Applications are open for spring 2026. Visit techgradcertificates.com to learn more and apply before the August 1st deadline at techgradcertificates.com. [Music] Delete Me makes it easy, quick, and safe to remove your personal data online at a time when surveillance and data breaches are common enough to make everyone vulnerable. Your data is a commodity. Anyone on the web can buy your private details. This can lead to identity theft, fishing attempts, or harassment. But now you can protect your privacy. That's why I've been using Delete Me. One of the best things about the service is when you first sign up, they give you the flexibility to start with just basic information. You choose what details you want them to protect. I started conservatively, but after seeing their detailed remover reports and experiencing their service firsthand, I felt confident enough to expand my protection. The peace of mind that comes with Delete Me service is invaluable. Knowing that a dedicated teams of human privacy experts is actively working to protect your personal information lets you focus on what matters most in your life. Some removals happen within 24 hours, while others might take a few weeks, but Delete Me manages it all. They keep you informed throughout the process and their quarterly reports show you exactly what they're doing to protect your privacy. Take control of your data and keep your private life private by signing up for Delete Me now at a special discount for our listeners today. Get 20% off your Delete Me plan by texting data to 64,000. The only way to get 20% off is to text data to 64,000. That's data to 64,000. Message and data rates may apply. Well, I hope most listeners will be familiar with text embeddings. Are there equivalents that you find in the embeddings you do or are there nuances to that process to get a proper knowledge graph embedding? There is. So there are different knowledge graph embedding techniques that you can use. So as you clearly mentioned the king and queen. So we have similar distance-based met uh embedding space. there are like metrics based uh loss functions. So the embedding space could be very similar to the text embeddings. And is there uh a lot of work to be done there or deciding how big the embedding is or you know customizing and tweaking that or is it kind of off the shelf? Right now it is offtheshelf methods but I'm definitely looking into how can I improve this embedding space in terms of so another parameter that we are looking into is called uh causal effects. As I said that we have these three different types of causal effects and how to incorporate these effects into the embedding space directly. So at present I'm using one of the work uh seinal work which has been done in this area called they have called this paper as focus E where they have incorporated the weights in the loss function but currently what I'm looking into is can I incorporate weights in the embedding space directly and for use it for the downstream tasks further. So that's an open research area that uh I'm interested in personally. What are some of the common applications of knowledge graphs? So one common application which I see is as I said like link prediction then knowledge graphs are also used for explanations cuz they are considered to be the domain knowledge. So everything that has to for example there are biomedical knowledge graphs there are gene knowledge graphs out there which basically means everything that has to be known about the gene or any particular disease or symptom is in that knowledge graph. So they can be used for explanation further. So let's say your neural network gives you an outcome that you have I'm taking a healthcare example that you have this particular disease. You can map that disease to a node in the knowledge graph and trace the path and see how is the disease linked to a symptom or linked to a certain gene that you might have observed in your data set. The problem of link prediction. Why do we why we do link prediction is based on an assumption that knowledge graph is inherently incomplete. We do say that it has domain knowledge but we also make this assumption that there are still information or knowledge which we have not incorporated or relations which do not still exist in the knowledge graph and that's why we have this one application of link prediction. So it makes sense that the knowledge graph would be incomplete. Is there a worry that it has some I guess false positives as well edges that are sort of spurious? That's an interesting question. So that basically boils down to uh what I work on that's the backdoor path which talks about the spurious relations that might exist. So inherently it should not it depends if you're creating a knowledge graph let's say if you use an LLM to create a knowledge graph and there are high chances that these podious relations might exist in it. But on the other hand, the knowledge graphs which are created by the domain expert, the assumption is since they are the domain expert and those knowledge graphs are based on the ontologies, they are less likely to have those purious relations. But in the case where you have these purious relations, that's where my work kind of fit in that how can we use uh the causal LP back or the backdoor paths in the knowledge graph itself and mitigate those porous relations. uh the effect of those purious relations in the downstream tasks. What is a backdoor path? So backdoor path is basically a non-causal path which connects the if causal variable to its effect variable in a way that it influences how much or they're both a confounders as well as uh influencing how does the cause variable affects the uh effect variable in a way. So if I take an example of a causes b there must there might be some common variables let's say there's a variable d which is both affecting a and b at the same time. So to just uh separate out the relation a to b we have to make sure that we are taking the variable d into account and do you know that from just context or the existing network or is it something that can be learned? that can be learned. Also, we do get to know this in terms of context. So, I'm again going back to the healthcare example because it is easy for everybody to understand. So, there might be a disease which is causing a symptom. There might be a context in which that disease would cause a symptom. So, medical experts or clinicians do take that into account when they are treating a certain patient. they might not give the same decision or the same diagnosis diagnosis to every other patient that they see. So just taking an example of let's say age affecting you know the blood pressure normal blood pressure level. So what is normal for me might be different than what is normal for somebody who is 60 years or 80 years old. So there is a context that you have to take in account. It can be learned. So in a way we have causal network learning algorithms. So which are known as causal structure learning algorithms. So once you learn the structure of a causal bay network, there are existing methods which will uh tell us that these are possible considering these two uh nodes. These are possible backdoor paths that exist between these two nodes. Is it possible to do a real world example or maybe a handwave v1 of a backdoor path like in the medical case or perhaps something else? Uh what would one look like? So back door could be thought about as a common cause or a confounder. We have this common causal basian network where we have the relation between smoking and lung cancer. There's a common gene which causes so there's a smoking smoking does not always cause lung cancer. There is a relation from a gene. So there's a smoking gene which causes people to smoke as well as there's a relation from a smoking gene which causes people to have cancer. So that's the backdoor path. So once you're taking the effect of smoking in causing cancer, you are missing out this context of smoking gene. So you cannot say that smoking causes cancer. It has to be in the context of the smoking gene. So take that we have to take this backdoor path into account when actually looking at this relation smoking to cause causing cancer. Why do the backdoor path become a problem? It leads to spurious correlations in a way. So as I said, if somebody is smoking, are we going to say, "Oh, this person is going to have cancer. That's not entirely true. They might or might not." Smoking is not the cause of uh having some somebody having cancer. Not necessarily, right? Not necessarily. Yes, there might be other parameters which we have to look into account before we we make this claim. With that concept in place, we can probably start talking about causal LP back. What is the purpose of this architecture? What are the goals? So the goal of this is people have started looking into I'm going to talk a little bit little bit background before I actually dig into causal LP bag is why did I even started looking into causal neurosymbolic AI and I hope that would make sense when I talk about causal LP back. I started my PhD working in a healthcare project. So I was coordinating my advisor's in IHR1 where we were dealing with pediatric asthma patients and we wanted to develop a personalized bashian inference model that when would be the so asthmatic patients are highly uh affected with the outdoor parameters. So right now Poland is very high in most of the cities right now and that can tend to flare up people's asthma. You could see there's a correlation. So there's a predictor there. So you can have a high conditional probability. But can I say that Poland is the only cause? There might be other environmental parameters going on. So we have ozone, we have AQI, there they might be going up all together at the same time. So what I was interested in was to pinpoint what is the probable cause. to practically do so you would have to take that patient put them into just the polar environment just the AQI environment or just the oval ozone environment and that is practically it's not it's not feasible that's why we do like randomized control trials I cannot run that randomized control trials for these pediatric patients so that inspired me to look into causality so how do I do that and I felt knowledge graph on the other hand gave me a lot of domain knowledge which it's It's practically not possible if you go to a doctor and tell them, hey, I have all this data. Analyze it for me. Give me all your domain expertise. They don't have the time to do that. But if you have a knowledge graph of of a disease or any domain that you're looking into, you can in a way supplement or complements the actual domain expertise using the knowledge graph there. So I thought why don't I combine these two domains together. So causal that's how causal neurosy symbolic came into account. Then I started looking into how people have represented causality. Causality is represented in the causal domain is represented using structural causal models or causal basian networks and I wanted to see how people are representing causality in knowledge graph which is a simple triple based so a causes b and then b causes c if it's a serial relation and I found a gap in there so I thought okay people are representing causality that is great that's a good start but what happens if this is a serial relation which is A causes B, B causes C. They would separate them into two different triples, which would be A causes B, then B causes C and then maybe a third triple which says A causes C. But when you represent this triple A causes C, you miss out the context that is B, which is very important. My goal was first to enrich the neurosymbolic AI space with the representation of causality which exists in the causal basia network. So I want to take whatever is there in the causal basian network and put it into the neuros symbolic AI space. So that's where we created a causal ontology which is one-on-one mapping from the Bayian network to the neurosymbolic AI space or the knowledge graph space. So it's not just about mapping the structure but it is also about mapping the concepts from the Beijian causal basian network space into the neurosymbolic AI space. So I've mapped the weights. I can do that. I can incorporate them into the embedding space. I can use them in the loss function to do my downstream tasks. The second concept that exists in a causal vision network is mark of condition or causal mark of assumption which basically means that given a relation or given any particular node, it is only affected by its direct cause and it's independent of its parents. So I also wanted to make make sure that we have all of that in one space which would be the neuros symbolic AI space. We have this uh I've used this uh methodology called marov base split when we are evaluating uh that scenario. Then comes the backdoor path. So it's like there are some confounders. So we have links in the knowledge graph and if we do normal link prediction because of those confounders we saw that the our results tend to be show inflated performance which is good for us but practically if you think from a causal spa uh standpoint those are not the correct results. My basic goal was have a holistic framework where I don't need just the Bayia network to do all the certain uh tasks that I do. So I have this one framework where along with the Beijian network I also have the domain knowledge everything in cooperated into one space. So that's what uh motivated me to look into causal LP back that we call it. So now doing link prediction but taking the backd door paths into account. So remove the backdoor paths uh in the evaluation space when we are doing link prediction tasks. Can you remind listeners what the weights represent? The weights are basically telling you how much. So given this relation A causes B. We have something called uh known as intervention. Let's say how much uh I have this relation that taking aspirin causes my headache to go away. Now I want to intervene and say no I did not take an aspirin. Now tell me how does my does my headache go away or not? How does that affects my headache being cured? This number is what we call the causal weight of this relation. So how much co taking edible or taking aspirin is actually curing my headache. So I think a traditional approach would be to use those weights directly in machine learning in the loss function. You want to uh make the you know if something has a small weight not so bad of a mistake to make but if it has a big weight you want to get that one correct. Exactly. Why is uh why is that not sufficient? depends on what tasks you are doing. In terms of the link predictions, this is not a well-known strategy that people have used. It's typically just take the causal relation into account. But there might be different relations. So there might be a relation from A to B, A to C. So if you're doing link prediction, all you're doing is taking the relation which is A causes and A a causes B, A causes C into account. However, the weightage of let's say A causes B is maybe let's say 5%. Versus the weightage from A to C is let's say 10%. So you would want your algorithm to give you the result for A causes what to be more likely C rather than B. So that's where the weights comes into account in the link prediction tasks. Can you talk more about how you get that included then in the embedding itself? How does your technique differ? We are using some of the existing work that has been done on using weights into the embedding space which is done by paper called incorporating weights into link prediction tasks where they have called this uh embedding technique as focus E and they have included into the loss function you you could use it with any embedding algorithms that you are using currently they have implemented with four so there's a transmold uh conv I I guess Holy. So these are four different commonly used embedding methodologies or uh embedding spaces that people have used and the way they are doing is let's say something has a loss function of let's it's let's let's take into account the distancebased loss function. So you won't want to increase or take this number into account when you're calculating the distance between the head uh the node A to the node C or to node B. Could we revisit the Markoff base split? What mistakes would you make if you didn't do that? So, some of the mistakes that you would end up doing if you don't include the mark of base split, you've already trained some of the links and you are testing on those links. So, you're biasing your test set. Is that like leakage? That is actually data leakage. So when you split the causal network, you would take a node and if you do a random splitting, there's most likely that some of the nodes that you have included in the testing set might have links which are already included in the training set or already would have a link to their parent in the training set. So when you're doing link predictions in a way that includes bias because you've already learned those links from your training set. So now you're doing link prediction obviously you'll have a better performance and we saw that that if we don't include the mark of base split we saw that the mean reciprocal rank that's a common matrix in the knowledge graph uh embedding space or the link prediction does increased by 42.3%. Good evidence that it needs to be there especially if you're doing causality because we want to incorporate causality in neurosymbolic AI space. So we have to take into consideration these phenomenas which are exist in the knowledge graph in the causal basian network space. So we've gone through some of the steps starting from the uh causal relationships into the network removing those backdoor paths. I guess it all amounts then to predicting new causal links uh in that knowledge graph. Is that with traditional methods or have you done something innovative there as well? So that's one of the traditional methods that people tend to do. One innovative way I have incorporated is using weights in doing causal link prediction. The other work that we have looked into is incorporating mediators. So this is another property of a basian network that you have mediators. So the serial relation of A causes B, B causes C, B is a mediator in this case and in that scenario or situation we have used hyper relational graphs. So those are not simple triple based we have uh this triple of A causes B would have another hyper relation for to this relation causes to let's say has mediator another node B. So this is another innovative work that we have looked into in the case of causal neuros symbolic AI or in cooperating causality into neurosymbolic AI and we saw good results significant improvement when you take mediator into account while doing a link prediction tasks and what sort of metrics or evaluations do you use to look at the quality of the output? There are two metrics that we commonly use. One is the mean reciprocal rank that is the MRR score. Another one is the hits at K. So we typically uh use hits at 1 3 and five sometimes at 10 which basically tells you the first time you do the link prediction task tell me how likely are you going to get the correct result at K. So how likely are you getting the first result which is the correct result. How likely are you get your top three results which is K equals to three are the correct results and are there any standard data sets you can use as benchmarks? Absolutely. So we are using one of the causal reasoning benchmark data set. That data set is not so common in the knowledge graph space but we have transformed that data set which is a visual causal reasoning benchmark data set called clever humans and we've converted that into a knowledge graph. So the data set itself consists of videos. So there are 700 plus videos of objects of different shape, size and material coming into the frame and colliding with each other. And they have defined at least 27 different types of collision events. So every collision event is different. So hit has a different semantics than push although they all are collision. And we have converted this data set into a causal clever humans knowledge graph which we are using as a benchmark to test on. But if you think about are there possible causal benchmark or knowledge graph based benchmarks available out there. There is still work to be done in that domain and that's uh something that we are moving forward to. One another common uh knowledge graph that people have used causal knowledge graph is a Wikipedia based causal knowledge graph which calls a wiki causal. But uh one area that we are actively looking into creating benchmarks to test our data sets or test our methodologies with the one you have. Can you compare your method to others? Is it apples to apples in some way that that's useful? We start with looking from a causal network standpoint. The other knowledge graphs that are causal knowledge graph as in the wiki causal knowledge graph. There's one more called cosnet. They're looking at causality from a text point of view. So they learn causal relations from textual data. So not exactly appleto apple comparisons there. But we can definitely work out something where we may be able to compare how wiki causal or cosnets and other causal or cause kg kind of graphs perform on the methodologies that we have imple implemented but we come from the baseline. So as you said our goal was to learn new causal relation. So another problem that's exist in the causal space is causal discovery where given the observation data you want to learn a causal network and our assumption is and some of the studies that we have seen the observation data is tend to be incomplete. It is just practically impossible to observe everything around in the world. If you use the traditional structure learning algorithms and the observation data because of the incompleteness of the observation data, the collected data, the network that you're going to learn is going to be incomplete. So we come from that perspective our goal is or my goal in a way is to now in I have this incomplete data. Yes, I have this incomplete knowledge or causal network that I have already learned. either learn or I have a domain expert who's telling me okay this is from this observation data this could be the possible network that you could have learned or this is a snapshot or a small network that yes we can give you another problem that happens with structural algorithms is at times especially this is true when you talk about real world examples they would learn relations which are not true because they are just looking into conditional probability or some statistical relation between the variables. So you definitely need a domain expert in the loop to tell you does these relations actually make sense or not and that's where knowledge graph helps in. So in a way we have converted this problem of causal discovery into transformed it into a causal link prediction technique or link prediction problem into the neurosymbolic AI space. That's a good description. Yeah, that makes it possible then. Really? Exactly. So now you have you can start with your simple or first with your causal network which you have either learned using the existing algorithm or a domain expert has provided to you. Now we map this into the knowledge graph space and use the knowledge graph techniques to learn it. So we we come from bottom up. So starting with the network and then enriching it. However, the other knowledge graphs which are causal knowledge graph which are out there, they are u more at a step two level I would say. So it's not about the causal network. It's about if there's a text given to you, they have learned the causal triples from them from there and then they are doing the causal link predictions. Are there any particular problems or maybe industries or things like that where you think causal LP back architecture can make a big impact? Oh absolutely. So uh since I keep on coming back to the healthcare example. So one industry and uh I think safety critical industries or application is where causality should be implemented headon at the moment. So healthcare is one area where we can think about so what is the cause of a certain disease or certain condition. The other area that uh we have looked at briefly uh and we are collaborating with is smart manufacturing. So at the University of South Carolina, we have a Mechnne Aerospace Center and we have a next team which works on creating a smart uh assembly pipeline where we assemble toy rockets and there are anomalies happening in the assembly pipeline. So anomaly which would mean that the assembled toy rocket would not have a nose or the top of the rocket missing, the base missing or one of the body part of the rocket missing. So doing causality there. So looking into root cause analysis into in the manufacturing setting. So that's definitely one application area that I see. The other area could be that uh we have also briefly looked into is autonomous driving. Can we actually reason about the action that this autonom that the car has taken the autonomous vehicle has taken. So these are some of the top areas where I would like to see the application of causality. And how do the techniques benefit explainable AI? So since we are using um knowledge graphs in this case explainability is one of the benefits of knowledge graph. So knowledge graphs are inherently explainable for humans. So we can definitely explain connecting tracing back our results to the other nodes and the parts in the knowledge graph to explain why did the link prediction algorithm or why did the neural network give us a certain result. What's next for you? I have a couple of offers lined up for a position as assistant professor. So that's my next step and I'm very excited for it. So some of the next or future work that we have talked about would be part of my proposals and maybe PhD students who I guide in my journey would be working on those exciting topics. I like interdisciplinary work. So my future work would mostly deal about extension of what I'm currently doing but in different and exciting domains and with some exciting domain experts. And is there anywhere listeners can follow you online? So they can always follow me up on my LinkedIn. If anybody's interested in collaborating or working on the same project or a similar area, they can always send me a message on LinkedIn. They can look up my website. So I have a have my website mentioned on my LinkedIn page. So there's another way that they can always uh look me up or send me a message or send me an email. Sounds good. We'll have links in the show notes for listeners to follow up. Thank you so much for taking the time to come on and share your work. Oh, thank you so much for having me. It was lovely talking to you.