Tutorial 1- Cloud Computing-AWS-Introduction To S3(Simple Storage Services)

Key Takeaways

hello all my name is krishnak and welcome to my youtube channel so guys today in this particular video i'm going to start a new playlist on cloud computing and i'm going to include aws first and probably if you have demand for microsoft azure and all i'll also be taking up as we proceed now if you remember guys some days back or some months back i'd also uploaded a video or a playlist on aws sage maker awsc america is the services that are provided from aws where you can build ml and dl models and use it for your problem statements for your business use cases and again remember this is not a free service at all now people may be thinking krish do we have any free services and all yes we definitely have free services that basically means if you are a new customer and if you log in if you create a new account you know in your in the aws console then what happens is that for one year probably you will be able to get some tire limits there is something called as free tire with respect to s3 buckets with respect to lambda function ec2 instance and many more thing now today i'll just not discuss about all the free tire things but everything you can actually search for it in the google itself like suppose if i search for aws free tire s3 limits so by default you can see that upon sign up a new aws customer receives 5 gb of aws or amazon s3 standard storage 20 000 get request and 2000 post request right and then 15 gb of data transfer and all the information are there if you really want to know more information about it like how much easy to instance which all easy to instance application you'll be able to get it as a free one which tire you'll be able to get it anyhow i will be showing you all those things in my videos i'll make sure that none of your money is deducted initially only when you are actually connecting with aws or creating your account there you have to in the billing dashboard you have to put your payment methodology so that a minor charge of one rupee or two rupee inr will be deducted just to verify your debit card or credit card is you know it is not fake other than that guys please make sure that just don't use any of the services just like that without having any knowledge otherwise suddenly some money will get deducted and you will not come to know and there are a lot of retired services if you go to this aws free tire here you'll be able to find out what all things are free how much like in this particular case you can see this right for in the case of free time for 12 months you'll be able to see amazon ec2 instance for 750 hours per month uh in case of amazon s3 you'll be able to get 5gb then uh amazon rds will be able to get 750 hours databases like amazon dynamo b dive number db dynamic db is just like a nosql pro database that is provided by aws itself you can also use this sagemaker also you will be able to use it for two months but understand there are some services internally that are used by sagemaker that may just charge you some amount of money so you have to be very very careful when you are doing it i i will guide you with respect to each and everything don't worry you know and as soon as we practice things we'll make sure that we'll also delete uh those so that none of the money money goes over there then you also have with respect to aws lambda aw amazon light stale and all so here what all things i'm going to cover in this entire playlist is that we'll try to understand about aws ec2 instance s3 bucket how do we code it what is iam and then what is dynamodb sagemaker lambda sagemaker is already being created over here i'll still more continue and create more videos regarding that and then we'll try to understand about iam identify identify and access management so first of all let's go ahead and again guys this link will also be given apart from that if you search for aws free time you'll be able to get it okay so all this information is there uh in today's topic i'll just give you or guide you how do you sign into the console how to create an account and then we'll probably have a look on to the brief introduction about s3 bucket okay so that is the first thing that we'll start with now first of all just go and in the google you just have to go and search for aws console login right so when you search this you will be getting the first link over here click on this why i'm taking this particular series because this there was a lot of requests for many of you regarding aws and it is becoming pretty much popular because the abundant number of services that it provides is very very handy it is being used by various companies my previous company also used to use this i've worked in both aws and azure but when i compare both of them i like aws a lot because it is quite easy okay now once i click this now i'll sign into the console and once i sign into the console over here you'll be able to see that probably it is asking me my email id and my password if uh you you are joined for the first time make sure that you sign up and now currently i'm just signing it because i have already created a account okay so if you are new to this just make a sign up guys okay so suppose if i search for aws console login okay and then if i go over here uh probably there will be a sign up button okay when you're going to the sign in probably i think here only you'll be able to find it out let me just sign out okay i think it will be somewhere here only okay otherwise i'll just search in the google okay aw amazon aws console sign up sign up for free i think i missed it in the starting time only so here it is account aws uh my account account setting this this is there so as soon as you probably click on sign in to the console or you will be having sign in to a different account so here it is just try to click on sign in to a different account and probably it will take some time i don't know why and then you have an option of create a new aws account it was not coming in my screen because i was just using uh with the help of my name so because of that i think it was happening like that right so i'm just going to go back quickly and then i'm just going to sign in over here now once i sign in you'll be able to see this is the entire dashboard of aws so like this you'll be getting aws services all services everything remember they are abundant services you cannot just use all the services nobody can be perfect in all the services so we will be starting with some of the services and as we go ahead uh which all are the most important services we'll try to run that which are the free services we'll try to run all those things so first of all as i said that if you really want to search for any services just click over here on services you will be able to get every services you can find out every information over here with respect to every other thing like suppose if you know about ec2 so you can also search for ec2 like this you will be able to get right it is a virtual server in cloud suppose you want to uh understand about s3 right so here you'll be able to see it now first thing as soon as you log in the next thing that you have to do is basically go to your billing dashboard so go to this username and go and select your billing dashboard and this billing dashboard here there is something called as payment methods you have to click over here guys and it is compulsory to put a debit card and credit card or a credit card remember for the first time it will charge you one rupee or two rupee inr just to confirm your other card is correct or not uh after that whatever will do will will will do in such a way that none of the money is basically charged from your account so after this uh you click on payment method add your payment method and just proceed with it okay so once it get it gets verified just go over here now uh the first three first first thing that we are going to do we will understand what all things are there in this particular dashboard here you can see that these all are your different different regions you can select one of the region and probably work on that remember one thing guys whenever you are selecting the regions uh it is said that this region should be selected based on the services that we are using okay probably suppose if you are using alexa services okay alexa services is also provided by aws at that time uh aws people say that you have to basically select ireland because from there to india suppose if i'm working from india the response time will be quite less similarly if you are probably using any services from india itself you may also select mumbai you know so that you will be able to get the response this regions are the places where audio servers different different servers are basically uh allocated over there your aws services are running and you will be able to use those services right so this is the first thing the second thing is that you'll be able to see your account information and all remember guys this account information is basically the information of the root user okay root user from this i can provide access to different different users to admins to to developers that all i'll show probably in the upcoming video where we'll be discussing about iam so let me first of all go with respect to the first service that we are going to discuss which is called as s3 okay so i'm going to select on s3 now if you don't know about s3 s3 is just like you can see consider that simple storage device oh sorry simple storage services so we have simple storage service so we write it as s3 they have given the terminology like that and here you will be able to create files buckets you know like suppose i have created buckets over here with the name of chris test one now inside this i have different different files like csv file it may be an image file it may be a video file so we can store any kind of file and we can store uh in such a way that we don't have any any problems with respect to the size and all we can store any kind of size any amount of files inside this right now for the free version we have 5 gb storage space available that are completely for free for at least one year okay so here you can store any kind of files so this becomes just like a big data hadoop where we can basically show anything as such uh remember in the real world scenario whenever you are working with any live streaming data right like iot diagnostic data and all companies who are using aws s3 they will be able to store all the information over here now what are the advantages of s3 what are the advantages of s3 guys if i just search for aws s3 charges suppose so suppose this is the entire information or the pricing you see that what they have basically written right uh first of all this pricing is very very cheap if you are using this s3 standard version i'll show you how to basically go ahead with this and all and this is also based on the region right now i'm in north virginia we saw that right uh suppose if i'm going and creating some of the files in us east north virginia at that time your pricing is something like this first tb per month is it is somewhere around 0.023 per gb right then as you go on increasing the size your price will be decreasing right if you are just using this s3 standard but as you all know that for a free version for the first the first user uh first 5 gb will be free and after that only the charges will happen if you're using this s3 standard if you're going with something else then here you have different different prices and similarly companies who are creating diagnostic data they will be going ahead with s3 gray sears they'll be going with s3 glacier deep archives so they are different different versions of s3 bucket s3 plans also okay so that you should be knowing and there's all things right now you don't have to care about because when you will be working in a huge project where you are getting lot of live stream data that time you have to understand that which one which plan you have to go ahead with okay apart from this uh there are some more information regarding this see in aws free tire you can start with amazon s3 for free in this you will basically be able to get 20 000 get requests you will be able to do at a time twenty thousand get request twenty thousand two thousand put request that is just like a post uh you can also with the help of code you can store information in s3 also i'll be showing you that probably in my next video but here i'll just try to show you how to create files and all uh that all things will try to understand okay and you can also see you can do 2000 put copy post list request 15 gb of data transfer out each month from one year for one year so this is one more additional things and you can use all this particular feature so let me go back to my s3 bucket now suppose how does s3 bucket work okay as i said that guys first of all always remember if you really want to upload anything first of all in s3 bucket we create something called as buckets okay buckets so we create something called as bucket here i give my bucket name suppose like test one remember what region i am actually selecting here i have selected e us east oyo us is too remember this region that i'm selecting is also pretty much important because when i am doing the coding i have to give this particular region name suppose from my jupyter notebook i want to access this particular s3 bucket read some csv file then actually prepare my model and do some of the pre-processing and training in my data science project at that time i really have to give this region name then uh there is also something called as block all public access i don't want to give this but here uh this is called a bucket versioning why bucket versioning is used i'll just tell you if i enable this and if i probably create a bucket see you can also do server side encryption you can also enable it right now we'll discuss about the server side encryption later on but just understand when we are doing this bucket versioning if we enable it here we are basically going to create a bucket okay uh it says test one is already there okay let me okay i cannot aws okay so i'm just created a bucket name called as uh chris aws again it is showing me error let's see okay chris aws one i have actually created the bucket so once i created the bucket inside this so here you'll be able to see this is my bucket okay now i can upload the file inside this now let me just show you how we can upload the file i will click on upload button i'll say add files suppose i want to add this particular image and as i said you that we can upload anything and remember as soon as i upload this particular image you'll be able to see the destination path will be something like this how will be using the destination path and all i'll show you when i'm doing the coding this is just the introduction video and after this i'll just upload it once i'm uploading it guys it is somewhere around 156.9 kb it has got uploaded perfectly now let me go back to my s3 okay so i'll click on s3 and let's see whether the file has got uploaded or not so here when i go to chris aws one here you'll be able to see that the file has got uploaded now this is very much important what if i'll tell you what is the importance of versioning please see to this if i try to upload the same file again if i try to upload the same file i think it was capture one right uh i hope it was capture one so capture one i'll just try to upload it again now you can see that it is pending now it is in progress and it is successful now i'll go to my s3 bucket and now let's see whether the same file will it get uploaded twice or what will happen just see over here okay sorry i uploaded capture one and capture two let me upload the same file again i just wanted to show you what is versioning okay so i'm trying to upload capture one again and then probably i'll upload it over here and after i upload it i'll just go back to my s3 bucket remember this this s3 is very very important for my model training and all if i have any csv files i can store it over there versioning is there what is versioning i'm just trying to explain it over here now see this guys i have this capture one okay now i'll go to this permission okay uh permission access point sorry uh so i okay just a second okay let me click on this capture one in this capture one since i have uploaded it two times here you can see in the version in the version also it keeps a record of that it keeps a track of that now why this is important just imagine that i'm training a specific model and when we do the retraining approach again that same model will be created again right in this particular scenario when we create the same model again with the same name aws make sure that it does not delete the previous version it will keep the version of the previous model so that if something wrong happens if by mistakenly something happens we can revert it as soon as possible okay we can also revert it see there are something like actions also you can download it you can do a lot of things right so this is basically making different different versions of the same file so that the previous one is lost launched and you will be able to use it if by mistakenly up even deleted uploaded or done something right so this is very very much important to basically understand and this is how you have to basically create like suppose first of all i told you that whenever you're working in s3 first of all you have to go ahead with the bucket name the bucket name with respect to the bucket name you have to select a region and from that particular region only you'll be able to access it if you're trying to create an instance other than that if you really want to access it from outside i uh that also you can do it and probably i'll show that in your coding mechanism like how to do it you'll be having an access key and password and you'll be able to do it but remember one thing inside buckets your files will be uploaded you can also have multiple folders inside this like you can also add like folders right and after you add folders you will probably be able to see that um with the help of folder structuring also you can also upload this particular file right so i hope you got a basic idea about s3 please make sure that you do this much this is just for the tutorial one to make you understand about the basic functionality of s3 now the next thing in the next tutorial we will try to find out how do we access the s3 bucket we can do it from our account also from a specific instance also and from normal coding with the help of boto3 library so this is the bottom 3 library which i'll be already taking in the next class so i hope you like this particular video um please do subscribe the channel and yes guys this series is going to be big because we are going to discuss about cloud computing and we are trying to see how we can use various services that are provided by aws so i hope you like this particular video i'll see you all in the next video have a great day thank you and all bye