Exploring Block Storage and Object Storage

okay hello everyone uh I hope you all are doing well this side I am your host and uh in this session uh we are going to see the types of storages which are there on your uh vulture Cloud okay so we will uh see the things from scratch and then we will uh go deep dive into this one and we will see how we can utilize this uh uh storages in our future uh applications okay so let me share my screen once and then I can start explaining okay I hope my screen is visible and uh I am Audible and uh guys can you uh confirm that I am audible or not please reply me in the chat box that I am audible or not and my screen is visible or not okay fine I got the answers uh my screen is not visible uh someone wrote that not visible properly okay now is it visible guys please let me know now it is visible okay fine so let us start on the types of storages which are there on your vulture Cloud okay so there are two types of storages mainly if I talk so the first one is your block storage which is mentioned here and the second one is uh your object storage okay so both the things depend on the uh architecture in which the data is going to be saved okay so first we are going to talk about the what is is storage okay so you can say the component of a digital device that can hold data okay where you are going to store your things things maybe your audio file or video file images anything which you want to store so the device where you want to store that we call Storage okay so uh let us understand why it is important so if I talk about this so you can see uh understanding basically I I already discuss the block storage and object storage so why it is important it is uh critical for optimiz optimizing the performance okay let us suppose if you have deployed some application over Cloud okay and you are lagging with uh storage part so at that time uh if you have the facility so you can attach a block storage with your uh instance okay to improve the performance okay scalability you can also utilize it for scalability and uh the storage which are available on cloud is cost efficient because uh you do not need to have uh Hardwares okay so you do not need to have Hardwares so you can say this is a cost efficient as well and uh let us see uh the types of storages and uh one by one we will export so the first one which is your block storage okay so if I talk about this block storage now so the data which is going to be get stored in the memory will be in the forms of blocks okay in a fixed size block here you can see the same thing so these are the blocks where your data get is stored okay and each block act as a individual piece okay so the data which is getting saved in this block will be separated from this block okay so you can say it it uh is going to be a unique uh storage type okay so the main benefit of of block storage which makes it different from your object storage is that you can attach your block storage with any instance instance in previous sessions we have seen uh what is instance and how we can create it instance or virtual machines okay so you can utilize this block storage by attaching it to the instance and you can increase the performance you can increase the scalability of your application or your server okay so is this clear to everyone the block is storage block storage is clear okay so let us talk about the uh types of block storages so the first one uh the first type is uh htd uh which you guys um uh may be aware about the magnetic type okay where you are going to get a minimum volume size of 40 GB and the maximum volume size you can see like 40 TB of a storage okay so it is a huge amount and you can see the technology which they are going to use is a rotating hard disk as I have mentioned the hard uh magnetic type one and uh availability uh if I talk so uh in the last session I have shown you there there are several uh uh data centers okay there are several data centers there are several availability zones so let me show you once again as you can see uh let me go to cloud storage and then block and let me click on ADD block storage so you can see the first one which I'm discussing about sdd okay I will come to this one so can you see these are there are several data centers all over the world okay vulture has several data centers so it it is available in most of the data centers okay so this is uh the one uh benefit if I talk is uh affordable as I have mentioned uh most of the cloud storages are cheaper okay because you do not require to have Hardwares okay the cloud service provider will take care of that is this clear to everyone I mean the sdd block is storage because we are moving ahead with the uh solid state type which is your nvme okay non volatile memori Express okay where you can see this can be and the minimum storage if I talk talk is a start from 1 GB to 10 GB okay this is costly so you are not going to get a lot of storage and uh the technology you can see they are using solid state okay it is also available in multiple uh Data Centers of vulture okay so what makes it uh different because of its performance we can choose this one and if I talk about the price now let me show you uh let us suppose I am choosing uh this one okay so it is going to cost $1 per of 40gb okay so see uh it is not expendable but you can uh see from here let me select this one it is showing uh dollar per month and let me select this one it is showing $4 per month okay so there is a price difference between both of them so according to your budget you can choose now what makes block storage better option because of its high performance we can choose this one because we will be able to attach it with our instance or virtual machines so if the performance is low so uh retrival will be bit slow so it it will be not it will not be a good option to go with this one so because of the high performance it is more preferred and uh as I have told like data is stored in the forms of block okay so there there will be uniqueness in the data okay and persistence is also the one key feature of it okay so is this clear let me check in the comment box okay fine so common use cases if I talk so we can use our block storage with virtual machines as I have told and we are going to have a lab on this on virtual machines we will uh create one block storage and we will attach it with a virtual machine or you can say instance or server okay you can attach it with the databases according to your requirement you can attach it with the containers as well okay the docker containers so these are the uh common use cases of your block storage okay so let us move ahead and uh create our block storage and uh then we will try to attach it with your instance okay so let me come back to the dashboard of for this one so first of all I am going to choose the htd okay and uh the one thing which you need to be careful uh let us suppose if you are going to create your block storage in uh Delhi region okay in the data center so your uh instance should also be there in the same Data Center okay so you need to be careful while creating the uh storage as well as your uh instance okay so I have selected Delhi and let me scroll down and uh here label uh you can give a name I am giving my storage one so after that you just need to click on ADD block storage click on it okay it is getting installed so wait for it uh in the meanwhile we can go to compute uh in compute from here we can uh create a server okay so let me go here I just need one user data now come back to this one now click on deploy click on deploy new server there is one option click on deploy new server now here you just need to choose the uh shared CPU okay because uh it is going to cost less money so choose this one and uh as I have mentioned you need to be careful while choosing the data center of your instance okay because the data data center of your storage is in Delhi so I am also going to choose Delhi the data center now I scroll down any operating system you can use I am going with alpine Linux and then scroll down and uh for this storage I am choosing this this 25 GB okay I don't need uh this IPv6 and I don't need auto backup thing okay so I am going to disable this one now I scroll down uh there is option you can paste it is not mandatory for you all I'm just putting this uh thing for testing purpose okay now I scroll down select uh this key value payer if you do not have click on this one and you will get an option to create a new key value pairer okay now I am going to give a name like block storage server Okay now click on deploy wait for it uh it will take some time to get installed uh meanwhile we can check our block storage is this ready or not okay now it is active okay we have all the things ready here okay uh there is one option can you see attached to so it uh for now it is not attached with any instance so it is showing blank here let us wait for our instance to get ready then I will show you from here now you will get an option to select your instance and we will choose our instance from here and we will attach it and then I will show you how you can do it okay let us cross check this like okay fine our uh instance is also running so let us come back to block storage go back to your my storage one now click on this button so this is how there are several servers so I have to choose this block is storage server select this one attach volume okay uh okay fine it is not let me check is this running or not it is still in uh installation mode so wait for it let me cross check from here from the console we can get a better idea like your instance is running fine or not so yeah it is still in installation state so wait we need to wait for it you meanwhile I can check your comments guys uh if you guys have any uh query or problem you can ask let it happen okay fine guys any uh problem in this in the storage part the things which I have done till now if you have any query or question you can ask like how you can create a block storage how you can create an instance okay now it is ready let me again check go to block storage and uh click on this button now go to instance and then let me select this one attach volume okay fine guys we are done can you see attached to this okay so our block storage which have 40 GB of a storage okay is attached to whom to a instance or to a server okay so by doing this you can uh increase the storage size of your server okay so this is the one beautiful thing of block storage and how to detach it there is one button if you let us suppose if you want to attach this block storage to some other uh instance so click on this uh detach button and uh then click on detach volume okay fine now again your uh uh storage is free I you want to attach it with let us suppose test server one so select this one click on attach volume it will get attached with the uh another server so you can consider it as a let us suppose if you have a hard disk or a SSD so you can consider consider it like that but the beautiful thing is that it is available on the cloud okay so any query or question guys because we are moving ahead with this block storage okay how you can create a block storage what is block storage okay sorry object storage we will move ahead with the object storage for now because block is storage is already done okay so let us move so in the lab or the same thing is written as you can see log to vulture dashboard navigate to block storage Tab and then click on ADD block storage and specify the desired size and reason which we have chosen as Delhi and once you created you can attach it attach it to any instance in the same region okay so we have done the same steps which are mentioned here and at the end what we did to attach a block storage with the instance click on attach to okay I have shown you from here you can attach okay so pricing if I talk it depends on the size of a storage okay so if you are going to increase the size so you will see the uh increase in price okay so this is the one benefit from here you can increase the storage so let us suppose I want 40 so I can show you how much uh I mean the maximum storage size so you can see the uh by increasing the size of your storage device your price is also getting up so according to your requirement you can choose okay now come back to your object storage now the second topic of our session is object storage but if you have any query you can ask and uh I will look into your queries for now and then we will move ahead with the object storage okay okay fine so let us move ahead with the object storage so basically the only difference if I talk is uh architectural difference uh okay so there we were storing the things in uh in the forms of block but here if I talk here the things is get stored in a bucket okay in bucket there will be one object there will be one more object there will be one more several objects can be put inside your bucket okay so the difference will be uh your architectural difference between the storage okay so let us read the definition object storage is a storage solution design for a large scale okay so I will show you uh for what for unstructured data okay so here if you want to put uh image if you want to put audio all of the things you can put it in the same uh bucket okay so unlike block storage where data is split into fixed block size okay here object stores data as whole object okay each identified by unique key and uh it is uh attached with a metadata metadata means data about the data okay so if there is one object so when it was created okay uh the date time all the things is cons known as metadata means the data about the data okay what is the version of your object so this these All Things Are comes under your metadata okay so this is the second type of storage which is there on your vulture platform vulture Cloud platform okay so let us get inside this so what is uh bucket okay so it is uh you can consider it as a container okay so bucket is no nothing bucket a simple container where you are going to put your data data means object object can be of any type uh image audio file video file so they all will be considered as object I will show you uh a live demo how you can put the things in your container okay so uh it it is going to organize the things and manage all the objects which are there in the container okay each object is stored within a bucket and uh bucket provides a way to organize and access these object Okay so let us suppose if you put some image okay and uh after putting this image you want to access it from anywhere on the globe okay so the things uh will be controlled with the help of your bucket okay bucket is going to modify the access of your object okay because it is a container without the permission of bucket you will not be able to access the things which is there inside the inside it okay so how you can access it you can access it using HTTP and restful apis so these are the things related to bucket is this clear to everyone the object and bucket part object means simple uh you can consider it as a uh video file audio file anything which uh uh you can uh store okay is known as object and the container where you are going to put your uh image audio files and video files is known as bucket okay the container simple okay so key features if I talk the scalability part and the metad DAT is also one key feature because you will be able to know who created this bucket and when it was created so this gives you a feature of metadata scalability object uh you can see object storage can be scal to petabyte of data okay so accessibility is the most beautiful thing about this uh uh you can access your objects from anywhere sitting in the globe from anywhere you can access this objects okay what is the common use case of it let us suppose if you have a static website okay so which include HTML CSS JavaScript so these kind of website you can put it there in the uh object storage okay you can store uh media files okay media files let us suppose if you have have a few GB of some data okay movie or something which you want to put you can put it if if you have some uh historical data okay let us suppose some documentary related to ancient time related to history so you can put it there okay it will be safe you can use it for backup as well okay and uh uh the most important thing uh for Which object storage can be used used you can use it for Big Data okay let us suppose if you are going to build some uh machine learning models you need to have uh uh uh put large data sets so in that case you can use this uh object storage okay so this will be one benefit of this uh in uh machine learning as well okay so these are the common use case of it and before we move ahead with the lab part anyone has any query or question okay someone ask me what is restful apis restful apis uh if I talk maybe you guys have work with uh Java or something so there you can uh create uh end points okay so with that help with the with the help of that you will be able to access your uh application okay so you can call that thing okay rest API so let us move ahead how you can uh how you can uh create a object storage on vulture so let us go to the lab first the first step if I talk you just need to log into vure and navigate to object storage so we we will do this and then the second step click on create object storage and choose the region where you want to host your storage so first go to the dashboard here go to object storage okay so all the things you will find in products when you click on this product now it will uh give you an option of compute so just below compute there is one option of cloud storage go to object storage here now there is a button add object storage click on this one now what it is saying select the location so it is not available in all the regions of uh uh the globe but uh in India we have bangaluru and Delhi so we are moving ahead with delhi now here they are asking for name my storage I giving a simple name click on ADD okay wait for it it is getting initialize okay so we need to wait for it let me open it the subscription is not yet currently active so we need to wait in the meanwhile we can read The Next Step what we need to do do after uh creation create a bucket so the Next Step will be creation of bucket we will see how we can create the bucket means the container which I have told you okay so we will see how we can create the container let me cross check once again Let me refresh this I think it is ready now uh we will going to use these things uh the host name the secret key the access key so there is one option of buckets click on this button now there is button to create bucket click on this create but bucket the bucket name there are you can see only lower case and uh start with later or number okay no spaces should be there bucket name may contain dashes okay we can have dashes and the important thing is that the uh length of the bucket name should be between 3 to 63 let mean show you let us suppose I have given uh RB so and let me click on create bucket it will give some error can you see unable to create bucket RB uh bucket name must be uh between 3 to 63 so if I am going to give more than 63 so it will also give some error okay so we need to be careful while creating our uh bucket name and the bucket name should also be very unique so let us suppose I'm going to give a name Sam bucket vulture if there is one bucket uh on the entire Globe by this name so you will not be able to create this bucket okay so if you want to see this example so let me check Sam uh let me click on create bucket can you see unable to create bucket I am uh Sami something about his name so the if the bucket name already exist you will not be able to create this one so it is not necessary that it should be there in your system in the entire environment of this vulture if there is some bucket by this name you will not be able to access it okay so let me give us again a simple name now uh you can enable versioning versioning means uh the versions let us suppose if you have uploaded some uh audio file today and uh again you are going to upload the same audio file so it will change the version okay sorry click on create bucket now your bucket is ready okay there is uh on multiple Cloud platform you will see you can create a folder here if you want so if you click on this you will uh fold uh create a folder F folder one so if it is required you can create it and upload files there is one option so for now on vulture there is a uh no option to upload uh uh your uh object from the browser okay they provide some other feature I'm going to tell you how you can upload your object object means audio file video file anything which is there as a data okay so let me come back okay so what we need to do what we need to do to uh put our object on the cloud because there is no browser support So in that case we need to use one tool which is known as S3 browser you can use AWS CLI reclone so there are several options but in our case I am going to use this S3 browser okay so let us come back to our dashboard and uh what we need to do uh just click on this button read tutorial click on this from there you can get uh overview like how you can uh utilize this thing okay the S3 browser so here you can see compatible tools now so in compatible tools you can see uh there are several things vulture web portal and uh the second one is cyberduck the third one which is your S3 browser which we are going to use so let me show you how you can use it first you need to download it from this link if you click on this click on this you can download it okay from here but I already have this one so I'm not going to download it but I can show you how you can use it so there is one button also how to use S3 browser with vulture object so when you download and open it so it will give you an option to add new account okay so what you need to fill you need to fill the account name any name you can give and the account type should should be S3 compatible storage okay so this is mandatory to choose okay and the rest end point okay the end uh end point with the help of end point we will be able to connect with our uh storage okay so we we we will find it over there I will show you where you can find this end point of rest API and then access key ID and then secret key okay both the things are required okay so let us come back and then you need to click on add new account now let us come back to our uh main page now uh come to overview can you see all the details here the host name okay the host name is similar which I have told uh like rest uh endpoint okay so this is the same rest endpoint and uh the secret key is here okay I will copy it and paste it and the access key I ID which I have shown you there so this is the same okay you just need to copy it and paste it so let me open my S3 browser so let me show you first how it is going to look like see S3 browser is going to look like this so click on this button guys uh my screen is visible and you guys are getting the point now reply me in the chat box I'm looking into to the same okay so let us come back so there is option accounts okay so what you need to do click on accounts and there is option of add new account okay click on this add new account button now the same page uh opened here okay so I'm going to give a name like uh vulture test account okay vulture test account account type as I have shown you need to choose the S3 compatible sto select this one rest end point okay so come back come back to this one now select this rest end point here from here copy this host name or rest Endo let me uh paste it here and I just need to give a port of 443 on which our storage running so let us come back again on the dashboard uh we need to copy the access key ID so copy it from here I have copied it again come back paste it here okay fine now let us uh come back and copy the secret key copy it from here come back to the same page paste it here now I think uh everything is done now we can click on add new account so wait for it it will get added okay go to this one vulture test account we have created select this now folder one which we have created on the cloud now can you see this one now it is available locally okay so this is the beauty of S3 browser means you will be able to see the things which are there on your Cloud uh here locally okay so there is one option to upload the thing let us suppose I want to upload uh image okay so let me go and uh select this designer 8 open it now it is available uploaded fine but let me show you uh apply changes let me show you on the cloud like our things are getting here or not in the bucket it it should go in the bucket as I have told the bucket is going to work like a container where all the things will get stored so let me refresh this page and let me show you in the bucket is something new yeah can you see this one designer 8 PNG now it is available you can see the version ID version ID is here okay click on the three dots if you click on this three dot you will get an URL copy this one come back to a new tab paste it and click enter can you see access denied okay you will not be able to access this object until and unless if you are not going to give a permission for it okay so how you can give permission so there is one option owner any AWS user all users so I am going to give permission of read okay any user can read my file with that URL the link okay so you can go uh give permission multiple uh permission to owner because it will be safe but for users you have to be careful while giving the permissions so for users I am just giving only one permission read okay so after uh uh taking this uh take this box and then click on apply changes okay now reload let us come back to the browser uh Let me refresh our page okay one more thing you need to do let me first show you first show you still you will not be able to uh see the object refresh it no no you will not be able to see it why there is one more permission you need to do you need to give so click on the three dots which is there okay here three dots now go to change access click on the change access click on enable Okay now after enabling this let us go back and refresh can you see we are able to access our diagram or design or image okay so this is the beauty of your object storage okay you can put any any kind of data let us suppose I want to uh upload some uh uh I can say video file here so let me go to this one upload file and uh so select this one okay now for this one uh I need to apply changes things are fine now come back refresh your page now go to this one sorry change access it is disabled enable it now what you need to do you just need to copy this thing and come back and paste it here can you see this is working fine so this is the beauty of your your object storage and uh the image and all the things which I have put it here now if I can share it with you all so you will be able to access this thing uh from anywhere in the globe okay so this can be used for storage okay any uh query or question in this object storage part you can delete the things if you want so delete it you can close if you want to delete Sorry if you want to delete your account from here so go to this one there is one option manage account so click on manage account I do not need this vulture test so you can delete okay save changes so from your S3 browser the things will be deleted okay close this thing now I do not require this so delete sorry delete permanently yes delete permanently and I do not require this one as well so click on this button now there is nothing okay I can delete the folders as well so if you want to put your uh data in the uh folder now so you can directly put the things in folder as well okay bucket and then inside the folder is there any query or question guys in the storage part so there are only two types of storages here on vulture Cloud on other Cloud there are multiple kind of storages but on our vulture there are two which is the first is block and the second one is object okay so if you want to delete this one first uh let me show you without uh detach you will not be able to delete it so let me so see it is giving error unable to delete subscription block storage must be detached before removing okay so first you need to detach your block storage from here after Detachment you will be able to delete this thing delete block storage okay so the same thing is mentioned here I have shown how to use S3 browser I have shown all the things how you can uh choose account type how you can uh choose the uh how you can uh write the rest in points okay how you can put this uh access key all the things you will get in your overview okay and then how you can upload files and modify permissions I have shown all of them from here you can apply changes after selecting these and then you can uh change the access from here okay there is three dot button you can change it okay enable it and then you will be able to access it is this fine for everyone so that's all I mean uh the things which we have covered is if you guys have any query or question you can ask okay okay fine so I hope uh this session was helpful to you all and uh I wish you best of luck for your projects and try to submit all of them uh as soon as possible okay so best wishes to you all and uh thank you for listening us okay bye