Data Science 101: CRISP-DM - Data Mining / Data Science in 6 Steps

Key Takeaways

and it would also be nice to do something about Chris diem is for crossed industry standard process for doing data mining so that muscles for the class of six major steps so when you find on google c RI SP - p.m. so it has six major staffs so it's going to be is a process diagram or communicate point it's the best practice so instead of tagging on its word you could follow when you want to build your first data mining birthday so they're Christian framework a business understanding so it's a first step so this is understanding completing your domain understanding soul in your closet is your domain understanding all seven of the children data that you calculate so that's your business so the thing is your objective of your project you have already told us that you want to correlate some parameters relating to the cognitive function it's a good function and and I'll see you looking into the height weight and BMI that's a common factor whether whether they underneath Olympic offers a question so you want to see whether we don't be speed or over weights will have any influence on their ability in class right and you thought he could it be that the exam so that's a revision is understanding so the next thing is related to be understanding so it in understanding context we have to get to know your data so we're lacking your domain so we have to talk to you so it would be nice if you have like a definition of each of each variable so that we can see and it is possible if you could group them because they each spot variables are cognitive functions defined variables for executive function so that the thing is if we are to analyze it as a group we might be able to compare the tracks if you have MS and very messy function versus copies of function you see whether they have any difference for comparing any much mass spec so the next thing will be to diligently the exploration so will people use SPSS or abuse basics itself yes comparer may cut count in the median percentage aviation of beast variable and remember when but we have the class they mention before class that you separated according to the BMI ready not to swim the whole weight by the way their normal right so for each of them we do stratifying did we do stratification of the data and for each of the four group you calculate the mean value and standard deviation money group for each variable box of memories of oil actually how many diction you have the motion control we healthy the parameters related to density function and the publicly Punishers we chose China by your class would it be uh normal whether they are slimming whether they are over Greece will be able to see whether we have any difference in the exit function and cognitive function so we will learn a lot from the data exploration is another first down and then we can decide that your how we can create our model maybe we want to stop anything together and build what the model or maybe want to selectively take out some variable or we want to compare contrast set up their faces maybe one of them compare executed function versus cognitive function whether they have any influence on their ability to learn and really of doing the analysis maybe if you go by the bar or an icon we can color them you could color the group of normal the group of puppies the boom of slim and then for each school and for each variable we'll be able to see the relative distribution will be able to see in general we can even use machine learning like principal component analysis so then we use in any general as the distribution of see the students on its label suited from the whole weight room right circle in the normal group with a big hockey game distribution there are similar among each of the school in terms of their ability to learn as measured by hypothesis function burgers and a special finding itself in foster care reports so there's a lot of things that we do and david preparation rightly the preparation is something there are missing values or maybe there will be some accuracy or that is maybe some features that we combine some features will be transformed if you will have a distribution of being over the feature if the feature distribution is not normally distributed or it's not so less is first you might need for beta we might do some walk transformation so that we can make the distribution on unit one right and then the next thing will be to actually create the model right so if this would be past summer will be the set that we turn off so if you got quality they tell me we can do classification or in that right you could use something like this you should treat right or we could use other black box analytically what we're going to seen then we'll network that's a good question but the thing I like about decision tree and record forest is that it allows us to interpret the moment so we can understand yes so you get an understanding of the inside of the prediction wall I just work what is panel what variables are important whether the top of the function is high and low would it make learning of your group student better or worse and the evaluation of assistance as I mention one little although we enjoyed them all you look at the feature we should be chartered plane and then that will help us to either the employee if we create that the model is satisfactory and then we will deploy the model by the deployment model we could also develop a date but navigation and then we give the web application to the teachers at school and the teacher from school can then measure or evaluate the group of the students based on the survey and we'll get to them right so you give them the survey that you use to collect the bingo sent me up here the assassins are ready to eat made into a web application and this to enter and then get a immediate feedback how can they what is theater competence function or learning capability score if we get that public school of internet obviously functions right it also positivity of the suggest us on what parameter the teacher or the Tyrians should put on that little aside right now so that the public discuss would be enhanced station we also just help out other students five years below under cognitive skills on what happiness a popular difference this has been scored low it is animos angular's so that tear pockets of individual who need asked instead of a fantastic example for our making of their site empty shell memories killing for the time but Monica should quite the earth Katie strength should know why we English woman primary venue were specific variable where we are we have this beautiful birthday birthday points and thickeners the development of each child should be customized retirement all child have the same positive capability right there might be other confounding factors that might influence the results very functional I suppose this means they're just the attacks let well maybe they're distracted so they're on the other issue that might influence the score right or muscle so that these might be some of the limitations of this study like so none the thing is how can find other variables to accurately measure they're outside the test yes maybe observation based on the entire semester based on only one snapshot in time apparently that night and then the quality they into the test and he didn't perform well they doesn't mean that he's not informing well but it might mean that maybe he's exhausted and just because of that baby he performed on surreal so there are other factors that determine coming for the teacher to be on a continual basis progression over time or maybe we could do it like a like average for an entire semester to something that then questions a student complicated function or a function over the life time spans there surpass that is only these small fragments of what actually happened that's maybe she'll hotner yes so follow up would be nice name and if there's possibility of Shawn not sure about like long-term measurements you know together baseline a noisy place maybe if you just you know measure it in one time frame and I gotta capture all of the sound in the room or all the week on signal right you know make sure there are signal so the signal could happen anytime and then when we're catching at time 1 to 5 maybe the signal will appear in time 6 to 10 so if you look capture the only scene of all the ice pack we might miss out on something for the signal so say this one s very good so obvious think that we should repeat we should we should we should review this new reservations maybe move me out of it that means not able to inspire friends thank you for watching please like subscribe and share and I'll see you in the next one but in the meantime please check out these videos