AWS Tutorial For Beginners | AWS Full Course 2026 | AWS Cloud Computing For Beginners | Simplilearn

Key Takeaways

Imagine building an entire AWS architecture. EC2 instances, VPCs, subnets, load balancers, security groups, all created perfectly in minutes without clicking anything on the console. Now that's exactly the level of confidence and automation you start developing when you understand AWS the right way. In this session, we are going to take a practical end-to-end journey through some of the most important services every AWS solution architect must know. We will begin with the basics, understanding core structure and learning how IM controls access in a secure and scalable way. Then we'll move into the real engine of AWS compute. You will learn how EC2 works, how storage options differ and how to choose the right instance, purchasing model or storage type based on cost, performance and business needs. And from there on we will step into automation exploring autoscaling, life cycle management, scaling policies, cloudatch alarms and everything that keeps your application running smoothly even when traffic spikes without warning. And once understand how to design architecture that scale themselves, we will go a level deeper. Infrastructure as code cloud form will show you how entire environments can be deployed, updated and rolled back automatically with reusable templates the same way real companies build production ready systems. Throughout the session, you will see some real examples to walkroughs, troubleshooting techniques and practical explanations that connect every concept to real world AWS architecture. So whether you're new to cloud computing or preparing for the AWS solution architect role, this one continuous session will help you move from understanding individual services to understanding how they all work together to build reliable, scalable, secure systems. Now before we move on, here's a quick information. If you are interested in growing your career in cloud computing, do not forget to check out Simply's Cloud Architect Master program. A complete learning path designed to help you master AWS, Azure, and Google Cloud. all in one place. This program will give you access to official AWS author learning content, a Microsoft Azure exam voucher, live interactive classes, hands-on cloud labs and certification aligned training for both Azure and AWS. You will learn 40 plus in- demand cloud skills, work with 25 plus essential services and earn official certificates from Microsoft as you progress. And with job focused projects, real world cloud deployments and expert trainers guiding you throughout the journey. This fourmonth online program prepares you how to design, build and manage scalable cloud solutions confidently. So guys, what are you waiting for? Hurry up and enroll can find the course link below. Also, here's a quick quiz question for you. The question is, which AWS feature automatically increases or decreases EC2 instances based on demand? Your options are cloud trail, autoscaling, cloud shell or IM. Let me know your answers in the comment section below. So guys without any further ado, let's get started. >> Very good morning all. I welcome you to simply learn words number one boot camp and even I welcome you to AWS certified solution architect associate course. Myself Muzil Dhakni I'll be your trainer for this AWS solution architect associate course. So total I have 10.5 years of experience in teaching and training. Right now I have a three certification AWS certified solution architect associate level professional level and AWS soft administrator. Three certification in AWS. Introduction to AWS. So before that what is cloud computing folks? Cloud computing is an ondemand remote availability of resources such as computing power, storage and networking that to without direct user management. Even if I take one more simple definition cloud computing is nothing but ondemand delivering IT resources over the internet. So what kind of a resources now power storage what you're doing in on-romises environment that same thing you're going to use in cloud environment and that too user is going to not manage that user is going to access the resources like virtual servers or a storage networking thing. So user is not responsible to manage someone is there behalf of you they are managing just being a client or a user you are going to utilize the resources. Now let me take one simple example for cloud concept. Everyone is familiar with the electricity board right? Electricity board just being a user you are consuming the electricity in your houses or offices and what you are consuming based on that you are going to pay for it. You are not going to maintain your infrastructure of this electricity board behalf of you someone is there to manage this but just you are using the service of that electricity board. So like that cloud computing also you're using the service but someone is there to manage that. So now folks do you have any idea what benefits I'll get if I'm using cloud computing cost optimization costs saving no upfront cost for resources scalability is also one of the benefit no need to think about the capacity also and the very important pay as you go model and no need to think about the capacity automatically scale up and scale down when it is required. Many services are available ready to use dynamic hosting as per the requirement less time to start an application. So these are the some important benefits for cloud computing. Now the companies that provide these services are called cloud providers. So folks as per my knowledge I know one of the cloud provider AWS. Do you know any other cloud providers in the market? GCP Azure. GCP is a product of Google. Azure is a product of Microsoft, IBM, Oracle, Alibaba. These all are cloud providers in the market. Now these services are accessible to the user over the internet. So always how you are using this cloud computing services by using the internet connectivity. So cloud provider ensure the large scale management of these services. So now this cloud provider they can deal with the large like a tier one company. They can provide a solution for beginners that to what do you call startup even cloud providers they provide a solution to individuals also. Now what is AWS? AWS stand for Amazon web services. It's a leading cloud provider which offers over 200 ondemand cloud services. These services are extended to individuals, companies, government based on a paper use model. So now folks in AWS it provides more than 200 services. Now what are the features I'll get in AWS? Why should I go for AWS? What is the reason behind that? The first one is reliability. Folks, even if you have a huge amount of a data or a low amount of a data, always the performance will be consistent and that to accurate also. Now scalability no need to think about the capacity because when I'm getting high traffic application automatically the resources will be increased when I'm getting a low traffic automatically the resources will be decreased that is the power of scalability in AWS environment now security let us consider this is my AWS environment now and here we have different different level let us consider this is level one this is level two and this is level three now I am providing some security group at level one I'm providing some knackl at level two I'm providing some VPC flow log at level three so now if I want to make sure that my AWS environment should be secure at that time I'm providing a different level of a security within the environment cost effectiveness as you know that pay as you go model how much you are consuming based on that you are going to pay for it now what about the market trend if you talk about the market trend so average salary of AWS professional is like $160 $60,000 And there is a huge demand of AWS professional that to 60% of a cloud computing jobs which require the AWS related skill. Even in the market you can see there are lot of opportunities are available. Lot of opportunities are available. There is only one condition a person should be skillful. If you are obtaining a solution architect course solution architect certification that means once you complete this course you are able to decide which particular service should be used in which situation which option should be used in which situation. So being a solution architect you know that. So once you'll get the grip on these services 100% you'll be hired in the market. Now what are the skills we are going to cover in this particular certification? Virtual private cloud storage services AWS security and IM identity and access management and finally container services. So now why should I go for this AWS solution architect course? All the organizations are migrating from onremism to cloud environment. Not only AWS, I'm talking about the cloud environment. So in every organization solution architect is required in the organization. Some of the people have the knowledge. Sir, I know that I know about the storage service, I know about the database service, I know about the comput service. So I can design the solution. No, that is not possible. If that person he or she is not certified architect, then it's not possible. See until and unless if you don't have that much of a depth knowledge about the designing the new car because being a solution architect you should know that in which situation you are going to use bus table class in which situation you are going to use standard class in which situation you are going to use general purpose. So that you should understand there is one more uh option in memory that is also one of the strategy. So being a solution architect you should know that when should I use which particular option might be you have the knowledge but do you think I can provide the optimized result? No. So the task of solution architect is providing optimal solution that to secure high performance cost optimized architecture and no doubt being a solution architect you are going to meet the requirements of current and future business needs. what they are expecting today and even what they are expecting in future. By considering that requirements you are going to design the architecture and solution architect is not responsible to only review the new infrastructure, new solutions. Even being a solution architect, let us consider the organization is already migrated to AWS. Now you can review that and provide the solution like how I can improve the architecture. For example, I'm using one of the EC2 instance T2.micro. But you are working with a huge amount of a load. So I can suggest being a solution architect instead of T2.micro, I can use T4.LA to handle that much of a traffic. This kind of a task can be identified by only solution architects. Now let's move on to the AWS overview. So folks, in every module you will get this scenario in the life of cloud architect. So now you are a cloud architect in an organization and have been asked to implement a solution in the AWS cloud. As a beginner in AWS focusing on core services such as computing, storage, database and networking services and even more. So now you must set up an AWS account and use the AWS CLI command line interface to interact with the AWS services and resources. Additionally, learn how to securely regulate access to AWS resources using AWS identity and access management service. To achieve this, you will learn a few concepts in this lesson that will help you to find the solution for given scenario. Now, what are the learning objectives? By the end of this lesson, you will be able to set up AWS setup and AWS account enabling access to the and utilization of AWS services. Configuring billing alerts to monitor AWS charges for f cost control and budget management. Then delegate access using IM roles to enhance the security and permission management. Then finally set up and work with AWS CLI for efficient interaction with AWS services. These are the learning objectives or even you can call it as a outcomes. Once you complete the lessons, you are able to answer the questions based on these topics. Now how you will define the infrastructure term? Infrastructure is nothing but a combination of software and hardware components. So now in AWS infrastructure if I talk the region is first point. So what is region? Region is nothing but a geographical area where your AWS services are available. Well, so this is one region. Now do you know how many regions we have in AWS? H it's 38 like recently AWS has updated one more region and do you know how many regions we have in India? There are two regions are available. The first one is Mumbai and the second one is Hyderabad. So as you know that regions are nothing but a geographical area where AWS services are available. Now one more definition region is nothing but collection of two or more availability zones. Why it is two or more? What is the reason? Why not one or more? See if one goes down if one fails like disaster occur for this. So second and third third is ready to provide the service. So in simple terms for high availability for fall tolerance for make sure that your data is highly available. So if I talk about the availability zones now what is availability zones? Availability zones are nothing but collection of one or more data centers. Then what is data center now? Collection of thousands of servers. How many number of availability zones we have? Earlier before September 1st it was 117. Now if I talk about the infrastructure 120 availability zones we have so recently launched region name is Newsland. And let me tell you folks minimum two or more availability zones are always available and maximum sixth availability zone in North Virginia we have. So what is the distance between these two availability zones? It's 60 mi or 100 kilometer or more. So why they are keeping 100 kilometer or more to avoid any natural disaster. See if one of the availability zone affects if you keep within a 5 kilometers even that affect to the second also then there is no use to maintaining the aes within the range. So that is the reason AWS has decided to keep this different availability zone 60 m or more than 100 kilometers always they maintain the distance. Now in the next slide you are going to see what I discussed just now here AWS infrastructure as you know that it's a global cloud infrastructure that offers the unmatched security broadriach and reliability as a cloud platform it features over 200 services supported by data centers worldwide. Now what is region? Region is correspondent to geographical area housing the multiple availability zones. Each availability zone comprises one or more separate data centers as I discussed in the first slide itself. Availability zones are nothing but the collection of a data center each equipped with the sufficient power network setup reliable connection within the distinct zones right that is the reason they are maintaining the distance between the two availability zone to maintain these data centers. Now what benefits I'll get if I'm using this particular AWS infrastructure? AWS will provide a ability to quickly increase or decrease the resources to your application as their requirement as their need and even it enables your organization to manage the cost effectively while managing and maintaining the performance and efficiency. This particular feature is beneficial for the organization. They experience a variable workload. Sometime the traffic is high, sometime the traffic is low. In that situation, scalability will support more. Now reliability AWS has a strong track record that to if I talk about the architecture the architecture itself designed in a way that to deal with the disruptions and even it ensure the high availability and continuous functionality. What exactly it means? It mean that AWS can provide uh uninterrupted services even in the event of network failover or any natural disaster. Now security in security you can say that it delivers the high level security through its firewall. Firewalls are nothing but filters which filters your incoming and outgoing traffic. The next encryption if I talk about the technical definition for the encryption. Encryption is a process where I'm going to convert from plain text to cipher text. Now encryption is nothing but or doing the encoding and decoding. Encryption is a process from readable form to non-readable form. Readable form to non-readable form. So there are different uh definition finally the goal is same but I'm using more simple terms to understand clearly. Now IM capabilities. So folks identity and access management by using the IM where you can decide who can access what that you are going to design by using IM services. Now next is performance efficiency. So let me tell you performance efficiency is one of the key attribute of AWS. It has the ability to run your services efficiently in a cloud platform. It can scale according to need of your traffic. It can handle a high volume of a traffic without dislining a performance and even it ensures the smoother operation and user can get a best experience. Now flexibility. So AWS allows the selection of your preferred operating system, programming language and databases. So now AWS has given this authority to you people. So you can select your operating system. If you want a Windows operating system, you can go for it. Mac, Ubuntu, then Fedora. Which operating system do you want? You can select that. Then programming language you can go for.NET, Java, Python, Ruby, Rails, and even uh more more different runtime engines are available for us. Now cost optimization. Cost optimization is all about pay as you go model. How much you are consuming based on that you are going to pay for it. Now here you can see in AWS infrastructure we are increasing the agility and decreasing the complexity and risk accelerate time to market. Now you can see that right now in the market there is a trend everyone is talking about only one technology in the market right now A IML artificial intelligence and machine learning NLP natural language processing. So now AWS has also provided some machine learning services, artificial intelligence services like we have sea maker, bedrock these are the services what we are using. So as for the market what market is expecting and that to what clients are expecting AWS is providing a solution to them. Now they are talking about the A IML now they are talking talking about the NLP natural language processing now they are talking about the different different kind of a things. So as per the market trends and as per the client's request even AWS is providing a solution every day AWS is updating what I got the information just now every day AWS is updating itself like last week it was 37 117 availability zone now September 1st AWS was released a new region called newsand along with the three availability zone total 120. Now let me tell you folks the upcoming region Saudi Arabia KSA and the Germany KSA Saudi Arabia they are planning within 2026 they are going to launch the new two regions. So every day as updating the infrastructure AWS is providing a solution to all the customers not only restricted to particular domain as per your requirements. Now everyone is talking about the AI ML we have the services called badro Sega maker. So even they are providing a solution in the AWS environment. Now increase innovation when someone is managing your infrastructure behalf of you then you will get the sufficient time to think something innovative like what your client is given the requirement based on that you are satisfying the condition as per your client but what I can add something new where I can uh make my client happy. So these are these are the features what I added from my end. So you will get some sufficient time to think something innovative things because your infrastructure will be managed by someone else and now being a developer you can think then scale seamlessly. What it means as a clearly specified in the benefits no need to think about the capacity when you are expecting high traffic automatically it will be increased when you are getting low traffic automatically it will be decreased. Now how we are reducing the complexity and risk. First optimizing cost as you know that pay as you go model how much we are consuming based on that we are going to pay for it. Then minimizing security vulnerabilities by providing a security at different different different layer. For example, this is at EC2 layer. Now I'll give the security at EC2 level. I'll give the security at subnet level. I'll give the security at VPC level. So there are different different layers we have. Right? So just for your understanding purpose just you can take uh level one, level two, level three. So you can give a security at different layers where you can minimize the vulnerabilities. The final reduce management complexity. How we are reducing management complexity? As I clearly specified in the first slide itself, there is no user direct involvement. Someone is there to manage your infrastructure behalf of you. So because of that reason you are going to reduce the management complexity. the management hack will be totally taken by AWS. Let's move on to the next topic called core services. So here we have the variety of services like compute, storage, database, developer tools, IoT and even analytics, security, networking, management, mobile, enterprise application. First we have compute. So what exactly the meaning of compute here? So compute service which offer the secure and resizable computing capacity in the cloud simplifying the web scale computing for developers. So folks here AWS has provided a secure and resizable computing capacity that means resizable how much you want as for your requirement you can do the compute task you can process your data. So this is very much helpful for the developers. Folks in AWS environment we are using the term called instance. Some people we call it as VM virtual machine. Instance virtual machine servers everything is a computerized service. Now let us consider this is my onremises server. Okay. And this is my EC2. Let me give one scenario to you people. Now you all 52 participants are my network engineers. Right? And I don't know anything. I'm your client. I want to design one server. So how you will take up this task? I'm your client. When you go for any of the project which is the first task see the first thing is requirement what your client is expecting. First you have to understand then you can select oh yes hardware whatever you want. Okay let me consider requirement first. Then next what is the next step? How many for how many user you want? Which operating system you want? like what are the things uh like what are the oper which operating system okay can I call this entire configuration part first is okay requirement then configuration then how much time you want let's take 1 minute okay let us consider my server is ready for 500 people now suddenly there is a huge hike in that traffic suddenly I'm getting thousand as a users so what will happen to this particular web server so the server will crash or slow down or a low latency. So what is the solution? If I take the EC2, launch the instance, select the operating system, select the security, then create an instance. And here you can launch the instance. This is my EC2. So my EC2 is ready within 2 minutes. And folks, when I'm getting the high amount of a traffic, automatically the resources are increased. When I'm getting a low traffic, automatically the resources are decreased. So this is totally pay as you go model. How much you are consuming? You're going to pay for this elastic compute cloud. This is one of the compute service. So now just you create an instance here you'll provide the operating system softwares EBS security everything. Now EC2 is ready. Right? When I'm getting a huge traffic automatically the resources are increased. When I'm getting low traffic automatically the resources are decreased. So which one is the best fit? So what are the key features? It empowers user to control their computing resources. They operate under pay as you go model. How much you're consuming based on that you're going to pay for it. It allows the user to the reboot new server instances within a minute. You can launch your servers within one or two minutes of a time. They enable quick scaling to meet the changing computing requirements with quick and easy configuration of the service. To meet the quick change of a traffic there is a concept called autoscaling group where multiple EC2 instances are available with the single group. So as per the demand it deals with the traffic. So what are the different comput services we have? You can see EC2 elastic comput cloud ECR elastic container registry ECS elastic comput service elastic kubernet service light serverless application repository lambda fargate and even batch elastic bins. So these all are the AWS compute services. Now okay so folks these are the compute related services. Now let me take to the next service called storage services. So folks uh what is storage? Can I say that it's a place where I'm going to store the data. So this storage offers a secure reliable scalable storage solution for a data in AWS cloud and that will provide the high efficiency availability durability and performance. So let me tell you folks there are different types of and that two popular storage types we have the first one is object storage then second one is file storage and the third one is block storage. So there is a popular service in object storage called S3 where you are going to create some buckets. S3 is a popular object level storage. So here you can store any kind of a data and that to unlimited where you can store images, video, uh audio, photo, anything and that too it's a unlimited storage. So what is the main use case here? Especially we are using for backup purpose, log storing purpose where I can store unlimited data. So this TS3 is integrated with many other AWS services where you can store and retrieve the huge amount of a data. Now if I talk about the simple a single use case now file storage. So folks file storage here there is a popular service called EFS elastic file system which is scalable shared file storage. So now let me tell you folks what is EFS? This is EFS and these all are EC2 instances. So now now EFS is shared file storage that can be accessed concurrently from multiple EC2 instances. Because of this reason this is well suited for the applications which required a shared storage. If you are familiar let me take where I'm using. For example, I'm using in content management system. Let me take the example of development. Right? Let us consider here developer one, developer two, developer three, developer four are working for the same software. But this first developer is working on first module. He is working on second module and he's working on third and he's working on four. And finally the data will be stored in this shared file system. This is the example for EFS. Now block storage. block storage here the popular service is called EBS elastic block storage right folks it's a persistent block level storage value so now you can attach this EBS value to EC2 instance this EBS is suitable for the application for example database data inensive application or let us consider if I want to install the operating system so at that time I'll install in EBS Why? Because here I'll get the low latency, high IO operations, input output operations. So that is the reason I'm going to install my operating system in EBS. Now you can ask why we can't use with the EFS. See in this we are not attaching with EC2. But here we are attaching this elastic block storage. Once I create the EBS, I'm going to attach with this EC2. That is the reason it provide the low latency, high IO performance. So your installation of operating system, database or uh what you call some of the low latency applications at that time you can go with the EBS. What is block? All the data let us consider this is my storage. So in EBS all the data will be stored in terms of blocks and no need to modify the entire document. If it is a particular part is there then you have to modify only that block. AWS will take care about that one. Now when I'm using this ABS what are the use cases? Let us consider if I want to install my databases or if I want to install my operating system at that time I'll go with EBS elastic blob storage. It allows the user to store access and analyze the data to reduce the cost increase the agility and accelerate the innovations. Right? So it can be broadly categorized into object storage, file storage, blog storage and even backup and data migration. These are also types but whenever you want you can take a backup into the backup services and data migration if you want to migrate from on promises to AWS at that time you can use the data migration services also now so what are the major services in storage ES3 EFS elastic file system fsx for windows luster elastic block storage then backup snow family transfer family then data sync storage gateway so these are These services which are related to storage. Next is database. Any kind of a data images, audio, video, photos, anything. Yes. What is database? Place where store the data. Then what is the difference between database and storage? Now, now let me give the definition for a database. Database is nothing but collection of related data. It offer the comprehensive selection of purpose to build the database suit for various application. So AWS has provided a solution for the different requirements. As for your requirement, you can select your databases. Okay. So what is the difference between storage and database? Storage is nothing but raw place to keep your data. Where you are going to keep your data like files, object blocks. But database organized storage management system with quering capability. So here the nature of databases you can store structured unstructured semistructured data right you can use the schema you can define the queries right you can define the relationship among the objects that is database now storage is all about just you have to keep the data safe and retrievable so here we don't provide any query relationships indexes nothing so now folks this database services are fully managed so when the term comes fully managed everything will be taken care by AWS Even updating, patching, provisioning everything will be taken care by AWS. No need to worry about this databases fully managed in the sense updating, patching, provisioning everything will be taken care by only AWS and this is scalable and highly efficient also. Now database services some features. So here it provide the different databases like key value database, inmemory database, graph database, time series database, ledger database. There are different types of databases are available. They support a multi-reion that means more than one region in all the 38 regions. Multi master replication that means in all the 38 regions you can perform readrite operation that is the replication and even which offers the control over the data. Now complete control will be user is managed. User will be taken care by the entire complete infrastructure of a databases. And what are the services are available? RDS, Red Shift, Ledger is also one of the type of database. Dynamob, Elastic Cachet, QLDB, Napune, Keyspace, Document DB. So these are the different database services which are available in AWS environment. What is networking? Networking is the concept where I'm going to establish the connection between two or more devices to share the resources. So now it offers a broad set of networking services. that provide the essential security features and robust network solutions in that these services isolate the resources. There is a service called a VPC virtual private cloud which isolate the resources. Let us consider this is gopinat VPC. This is Santo VPC. This is Deepi VPC and this is current VPC. Now see no one without Gopina permission no one can enter to this VPC without Santos permission no one can enter to this VPC without Di permission no one can enter to this VPC without current permission no one enter can to this VPC that is the reason we are calling it as a isolated area VPC is nothing but it's a isolated area no one can enter without owner permission every services will be deployed in the VPC only so being the owner of that VPC. You are going to decide who can enter, who can not enter. Then encrypting data. So in AWS folks, AWS supports advanced encryption standard 256 algorithm to encrypt your data. And there is a one more service called KMS key management service. It's a centralized repository which maintains a cryptographic keys for encryption as well as decryption. Now AWS provide the private connection to AWS global network. So what kind of a private connections like which connections we are going to call it as a private connection is this VPC establishment between the regions. If you want you can do that but two if you want you can do that. There is a concept called VPC pairing like if you want to peer the two VPCs that is possible. Now if I want to provide the private connectivity which connections you are going to call it as a private connection. Can I consider a VPN? Can I consider direct connections? direct connections then we have side to side connections VPN direct connect side to side all are the examples of a private connections now what are the feature it offer the highest network availability with very few time hours due to networking issues and it provide the global coverage of how many regions 38 and how many availability zones 120 now these are the services in a networking VPC gateway way, CloudFront, Proud 53, Mesh, Cloud Map, then we have direct connect and VPN connections. So these all are the networking services which are available for us. So there is a page called AWS infrastructure where you can see all the regions all the regions. If you see here these are the available region US region North Virginia and here Europe span Zurich London Europe. So these dark circles are already available regions and these are upcoming regions. Now you can see Europe upcoming region, Kingdom of Saudi Arabia upcoming region and here if I talk about the India there are two regions first one is Mumbai and the second one is Hyderabad. Okay 38 like regions 120 availability zone 700 plus point of presence 43 local zones and wavelength zones. So local zones are nothing but uh single digit which provide the singledigit latency to the customer. So local zones are not available in all the availability zones. Only selected local zones are available in every region. We don't have a local zone and wavelength zones are specially designed for 5G purpose. Let's move on to the next topic called account setup. So now folks, if you want to access the AWS services, first thing is required account. How to access the Gmail account? First we have to register for that first username, first name, middle name, last name, recovery password, mobile number, everything personal details you will fill. Then you will get the username and password. Now sign up process is only one time then you have to login. So like that in AWS also there are two types of account we have. First is root account and the second one is IM user account. By default root account have the access to all the AWS services. Now I im user have the access only what you specify the policy. For example S3 that means you can work with only S3. If you attach IM policy then this person can work with only IM. If you specify RDS that means this person can specify only RDS. So here you will get a complete control a more granular permissions you can assign here if it is required. How to create a root account? Same procedure like our Gmail. first name, middle name, last name, password recovery, mobile number, alternate email ID, everything. The only difference is here you have to put debit or credit card details. Now AWS will debit one token amount from your account. So once your account is verified successfully after 24 hours again that token amount will be credited to your account. If you go to the AWS console, you can create a root account. So within the root account, you are going to create a IM users. AWS is also given clear input. Don't use your root accounts for day-to-day activity. Why? If something went wrong, if the credentials are compromised, then you are gone. So that is the reason for a day-to-day work. Create IM users provide the more granular permissions. They can work on that and don't share the credentials with others. Now like how we are going to perform this creating account AWS console just type www.awws AWS console. Then here click on create account. Then continue whether it is personal or business account. Provide the personal or company information. Accept the agreement and create account and continue. So here it ask for billing information. Verified. Provide the pin number uh mobile number. Then by default one basic support plan will be available. It's like a customer care. Now if you want some advanced plan you have to pay for that. Once everything done your account will be activated. If you create a account in AWS console the account what you create is called free tier account. Free tier account is valid for 12 months and within this 12 months you have some services with this free credits like EC2 instance 750 hours S3 bucket 5GB. After 5GB 750 hours you have to pay the extra amount what you have. This is free account. There are three types of account we have. The first one is 12 month free tier. Always free. There is no restriction. But even we don't get any services here for a free like what we are getting in 750 hours five 5GB in free tier. Right now the next one is short-term trials. So let us consider is one of the developer for one organization called ABC. Now AWS is released a new service called Bedrock. Pratip is very interested to see this service bedrock. Now he'll request to AWS. Can you give me a access to the bedrock service? I'm a developer. I want to know and understand this service. Okay. AWS will give a response. You can use this bedrock service for 7 days. So understand the service and let me know if you face any difficulty. So we are calling it as a short-term track. So for one week bedrock service will be provided to the customer. Now let's move on to the AWS management console our lab environment. So now here once your lab is successfully loaded you can see sign in link username and password. Let me tell you the one important thing. So once you enter to your AWS console you can see some access denied option and all right. So no need to worry because here in this console only the services which are related to AWS solution architect associate these services are enabled. You can't access the other services apart from what we have for our courses. Right? And once you enter to your AWS console, the first thing is you have to check in which region you are working. Right now you can go for North Virginia. Let me tell you the reason why we are selecting North Virginia region. Folks the reason is this is pre-cooked environment for you people. Only North Virginia region is enabled. Here you can see in this AWS console all the AWS services. Now let us consider compute. So here EC2, image builder, elastic bins, global view, lambda, light sale, all these services are available. Now let me take database SQL RDS the document DB dynamob elastic caching key spaces memory DB then networking gateway app mesh cloud map cloudfront data transfer direct connect global accelerator then then then okay networking storage backup EFS disaster recovery FSX recycle bin S3 glacier and even more so these all are services what we we are going to use in AWS environment. So now here you can see search option. If I want to search this specific service called ES3 just type that service name and here you have to here you are able to see the services. If you want to bookmark this just click on this. Now the service is available. If you want to remove from the bookmark list you can remove this. Okay. Now after search here we have cloudshell. Cloud shell is nothing but built-in command line interface. If I want to interact with the AWS services by using CLI at that time I'll go with cloud shell. Okay. Now next notification help support then settings this is for regions and now here you can see so here you will get the account details for this account. Then organization if you want to go for multi- account environment then there is option called organization service kota that means every services has some limit for example uh IM users within the single root account you can create up to 5,000 IM users so like that for every service we have some kota that is limit okay then billing and cost management so let me show you a very important part let me tell you billing is one of the crucial service in every organization that is the reason no one will get a billing access only the respective person who is working on the billing they'll get the access but let me explain what are the fields are available in the billing now you can see cost summary month to date cost year and last month details like current month here you'll get the detailed breakdown for that particular month how many services are active in which region when it was started when it was end and how much it was charged. Everything you will get a detailed information. Now if you see here there are different tabs are available. Let me take which are very important bills. If you click on bills you are able to see like if I want to view the bill of last 6 month, 1 year, 2 year you have to select the year and particular month then a bill will be generated for that particular month. Then payments. Let us consider you want to do the AWS account like AWS account. You have to pay. Now you have the account called 1 2 3 and you want to pay for this. So you can add the payment method here like credit card, debit card and UPI payment using the Google pay, phone pay also you can pay your AWS bills. Then credits. So folks, credits are nothing but which is provided by AWS like for a free tier account 750 hours for EC2 and 5GB for ES3. So how much it is remaining everything you'll get the details in a credit option and whenever you're using any of the services you will get the purchase opter when you click on cost explorer you will get the detailed information. If you want to optimize the cost then cost explorer is a tool where you can go for it. So this is for total cost, average monthly cost, service count, how many services you are using. And here it's like a dashboard. It's like a dashboard. A systematic graphical representation will be provided which if you select any of the particular month service. Here a detailed graph will be provided for which service how much it is utilized in which duration everything you'll get the detailed information. And here cost and usage breakdown. And even you can download this as a CSV file, Excel file. Now when uh which service in which region when it was started, when it was end and what are the charges even you can download the Excel sheet. So this is all about the cost explorer folks and this is all about the billing part. So why we want billing? So billing is the tool where you are going to pay your AWS bills. So where you can organize and report your cost and usage by using AWS cost explorer then you can manage the consolidated billing for the member of AWS organization. There is a service called AWS organization where you can manage a multi- account environment. Here you can manage a consolidated billing. Let us consider this is ABC account. Here we have a different different employees and you will get a consolidated billing within the ABC. So these are the accounts and these are the charges. I'm not sure but uh there is a one telecommunication industry which provides one plan one family. I think it's a right only one bill will be provided for entire family. So like that here also for ABC organization I can do the consolidated billing where every users every users along with the cost you can see here. So as I discussed just now all the tabs these are the features which just now what I discussed in the console managing AWS account where you can view the bills you can manage the payments Google pay cards everything you can manage the purchasing orders then you can manage the cost by using the cost categories then you can manage the payment profile then a consolating like consulting billing organization let us consider this is ABC and here are the employees in an organization there are multiple employees we And every account is charged and you will get the consolidated bill for that. Now there is something called AWS support. Do you think these support people are like a customer care people? It's a technical support. These people are technical people that too they are well qualified, well trained who is going to provide a solution to you people. So now AWS supports provide the variety of plans to access the tools right and even expertise to support the success and operational health of AWS resources. So always 24 by7 access to the customer service if customer is not ready to accept the answer they'll provide some documentation documentation technical paper and even support forms. Now here we can see there are different plans we have developer business enterprise on-ramp enterprise and these are the uh scenario like what are the advisory best practices to check like technical support then case severity then programistic case management then proactive programs and self-services self uh like AWS managed services training pricing so pricing is also different in every model so here the different plans are given based on your workload how you are going to understand like if I consider our go mobiles once you complete 50% of a data you will get the notification once you complete 90% of a data you will get a notification you are completed this much of a data now here in AWS also you can set let us consider this is my EC2 this is my EC2 a compute service putting the threshold value if my EC2 crosses $200 $1 then it should be notified to the kiran. Kiran is a user. So once my EC2 crosses $200 I'm going to set the alert the EC2 CPU utilization this now when it is crosses a user will be informed by using email. So now you can see here AWS billing alerts which allows user to monitor the charges on their bills. So now user can set up a alert to receive email notification when the estimated charges reaches to the specific threshold value. Once it crosses the $200 your EC2 instance so through email it will be informed to Kiran. Hey Kiran, your EC2 is successfully crosses $200. Take some proper action. You can specify the action. If you want to do the automation once it crosses the $200 whether my EC2 should be stopped or terminated, you can do that one also. So how to set this billing alerts go to AWS billing console here and once you'll get the billing dashboard. So at the left side here we have the billing preferences. So click on receiving billing alerts and save the preferences. Once you add this email id you'll get the notification. So this is all about the billing alerts. So now how you will define delegate? Let me take one simple example. Now the class is a live session is going on. So I'm a trainer. I'm taking this session. Right. So what I'll do now? I'll inform to Vishwan atan. Okay. So being a trainer I'm busy in taking the session. I'm continuously busy in taking the session. What I'll do now? I'll delegate my authority to Vishwanatan. Hey Vishwanatan, can you take uh attendance for today's session? I'm busy. Can you take the attendance? So Vishwanat is ready. Sir, sure, I'll take the attendance. So what I did just now, I delegated my authority to Vishwanatan. Suddenly Shen will come into the picture. I'll take the attendance. Do you think Shen is the right person to take the attendance now in this scenario? No. Because I have not delegated the authority to Shane. I have given the authority to only vishwanatan. Now delegate access to the billing console. So now you know that AWS account owners can delegate access to specific IM user that need to access or manage the AWS billing and cost management data for AWS accounts. So now as I discussed billing is one of the crucial service right. So now everyone don't have that billing access. So now you are going to delegate this billing access to IM user. Let us consider this is your ABC organization. Here we have admin. Priti is admin. So now folks in this company we have 100 people. Do you think this 100 employee work can be performed by only one employee that is Priti. Is it possible? No. That is the reason we have delegation. Even every user have the responsibility. So that is the reason here we have Vishwanatan. Then we have Jes. Then we have Nukur. Okay. Next we have Kiran. So now Prii is administrator. Now being a administrative account or let us consider she is having access of root account. And now she's delegating authority to others. Vishwanat can perform S3. Jesh can perform KMS. Nupur can perform EC2 task and Kiran can perform billing task. So here we are attaching some policies like we are giving the authority to Vishuanatan. Priy can access all the AWS services because it's a root account. Now Vishuanatan can access S3. Vishuanat can't access KMS or EC2 or billing only S3. Same thing Jesh can't access S3, EC2 or billing. Right? So even Kiran can't access S3, KMS or EC2. Kiran is responsible for only B. So domain what they are provided to these employee they can work on only that place. How to delegate the authority to this Kiran user. So there are four steps. The first one is you have to enable the access. Enable in the sense for billing IM user and role should be access. First you have to enable then create a policy. Now no need to create a policy already policies defined by AWS. We are calling it as a managed policies already policies available. Now who is user Kiran? Just attach this policy to Kiran. Now check by using the IM user credentials. You can check you can test the access by using the separate username and password. You can access the resources. Let me show you. Okay. Just you have to go to the IM user. IM. So this is my IM dashboard. So now let me create a IM user. So who is responsible for billing now in our scenario in ABC organization? Vishwanatan, Priti, Napour, Jesh, Kiran. Okay, let me consider as Kiran. Okay, now folks, it asks do you want to provide access to AWS console? Yes. And do you want to use autogenerated password? No, I want to use custom password. Let me give the name called Kiran at123. Now user must create a new password in next sign in. Do you want to give the authority to Kiran to change the password? No. Let's click on next. Attach a policy directly. So folks, which policy do you want to attach? Billing. Just type billing. So folks, no need to create. It's already available. Select this and click on next. Right? So now review it. And once I'll create a user, you will get the error. Like here user is created but with few errors. Let me show you. Kiran user is created with few errors. See if I don't have authority to access the billing information then how I can assign this policy to someone else. See user is created but with few errors. You don't have authorized permission to attach the policy. See, so here you can see Kiran user and password. Just now the user is created. Let me open another browser. So let me copy the password. So now you can see this is account ID and the username is Kiran and the password is Kiran at 1 123. Once I click on sign in the user successfully signed into the account. Can you see this the username? Now I successfully logged in by using the Kiran as a user. And if you go for billing service even Kiran is also not able to access the information. Let me show you that only. First if you want to enable first step is here account section here I am users roles access the billing information you have to enable. Once you enable then create a user attach a policy then access. Check it out. Just now what we are completed uh four steps activated billing access. We are not created. We are using the managed repulses which is defined by AWS. Then attached to the kiran then tested access by using the username and credentials password. So now there is a concept called IM roles. Just now I discussed with you people regarding IM users. Now there is a concept called roles. How we are delegating authority using roles. Let me tell you folks these roles are temporary in a nature. Why we are calling it as temporary? What is the reason? Because these roles are active from 1 hour to up to maximum 12 hours not more than that. Now AWS account owner can use a role to delegate access to the resources in a different account called production and development. So one of the best use case of role is cross account access. Now let me explain what exactly the role by taking one simple analogy. I hope everyone is familiar with the Spider-Man. Actually Spider-Man is a normal person. When the problem occurs he'll become a Spider-Man. Once the problem is rectified again he's going to become a normal person like he is not going to work as Spider-Man for 24/7. So can I say that the Spider-Man is a temporary role folks? Let us consider production and development. Now I have production environment in 1 to three account and there is another account called 456 in development. Here in production we have Prem is working. Prem is working in production. In development environment Praep is working. Prem and Praep are very good friends. And now here we have an RDS database where in development environment. Now Prem suddenly asks to Praep, hey Praep, can you share your credentials? I want to access the RDS of development environment. No, it's against the policies. Right? So what I'll do Praep will inform hey Prem instead of that I can do one thing. I can create a role for you and what you want which access you want. I'll provide a RDS full access and this role should be assumed to frame and that two this is for two hours. Now after assuming this role to Pra, Prem can access the RDS database. This role is active for only two hours. Once the task is completed again is going to work as a production employee. Now here you can see the steps. First you have to create a role, grant the access and touch the access. Let me show you the same thing in the console how we are delegating authority. Now if you if you see here there is option called create a role. Let me create a role. Now see you can create a role for account also. You can create a role for service also. Now let me create a role for EC2. And now click on next. So which permission do you want to provide? Okay. Let me give the scenario here. This is my EC2 and this is my S3 bucket. If I want to access this is this EC2 should access S3 bucket. At that time I have to create a role. So role is S3 full access and this should be assumed to EC2 then only EC2 can access the S3 bucket. So now folks I'm using EC2 service then click on next. For which permission do you want to give? Select S3 full access. Click on next and the role name is demo06. Click on ro and let me show you demo06 role is successfully created. Here you can see the name ro demo 06 is available for me. Folks maximum session duration from 1 hour to 12 hours and even if you go for custom duration also you can provide in terms of minutes and but maximum is 12 hours not more than that. So this is the way how you are going to edit the roles. So as I discussed folk these are the three steps. First creating the role then granting the access to the role like what I assigned then you can test the access by using a different account. IM identity and access management. IM is a service which provides access control to AWS resources. In simple terms you can say that who can access what which provides access control to AWS resources. Now AWS identity and access management is a web service that enable users to securely regulate access to AWS resources. Now it enables user to secur securely regulate access to AWS resources. So in the secure manner how you are going to access the AWS resources based on the permissions. Let us consider Sender is using S3. So why is he using S3? Because I have attached the policy. Diwalker is using EC2 because why? Again we are attaching the policy. So based on the permissions and policies we are going to access the resources right and now IM helps determining the authentication that is signed in and authorization permission to user to utilize the resources. Now authentication if I take the example of online banking first username password then capture OTP then submit once you submit this all the information will be validated. If everything fine then only you will be signed in is nothing but authentication. Then only you will be redirected to online banking dashboard. Right? This is nothing but authentication. Now what is authorization? Everyone is familiar with the online banking dashboard. Here my online banking dashboard is available where you can check the balance. You can take the statement of 3 months or four months. Then you can add the beneficiary. You can change the password. You can change the transaction password. Even you can do the deposit and everything like some investment. Now here we have the option called balance. Is it possible to modify the balance? Modification of a balance is not possible. That is nothing but permissions. Authorization is nothing but permissions. What are the permissions? You have to perform the task. You can change the password. You can get the uh statements. Then you can add the beneficiary. You can change the password transaction password. These are the permissions you have. But you don't have a permission to modify your balance. That is nothing but permissions authorization. Now some of the features of IM so shared access to AWS account user can authorize others to administrator and utilize the resources in their account without sharing their password or access key. So what we are created I think we are created a user called Kiran Kiran because I have not shared my credentials to that user but I created a one user with separate username and password and here granular permission. to assign a multiple permission a various permission to the multiple user for a different resources based on workload. So there is a concept of principle of list that means the required policy if he's working on S3 only assign S3. Hey I know Kiran is my best friend I'll assign all the policy which is not best practice. Now securely access to AWS resources. By using this IM feature, you are going to access the applications which is running on EC2 instances. MFA, OTP. There are multiple methods we have. You will get the OTP on registered mobile number on a specific application like Google. Google is one of the application where you'll get the TPS. Identity federation. For identity federation, let me take one simple example. See this is your AWS cloud and here IDP identity provider. Now here we have third party user. Now this AWS cloud is belongs to AW ABC company. Now if third party user want to access the AWS resources at that time he should verify by the identity provider. Let us consider this user having the credentials with the Gmail or a Facebook.com. So now using the Gmail and Facebook I want to access the AWS resources. At that time IDP is responsible to authorize the user. Once the user is authorized then only he or she can access the AWS resources. Not only organization people even outside a third party user also can access the AWS resources. If you don't have AWS account you can use Gmail or Facebook account and IDP identity provider who is going to authorize the user. Once the user is authorized then only you can access the AWS resources. There is a service called cloud trail. Cloud trail is a service which tracks each and every API activity in the AWS environment. Who is doing the task? What are the results right when the user is performing the task? Everything you'll get the detailed information by using cloud trail service. Now this IM is compatible with PCIDSS standard that is payment card industry data security standard and IM is integrated with many other AWS services. So always the performance is consistent. Why? Because it distributed across the multiple global data center. IM is a free service which services are going to be involved to execute this task that for that you are going to pay for it. There is one more service called STS security token service. The security token services responsible to provide a temporary credentials to the roads. Okay. So STS security token services is also one of the uh feature in the AWS account which provides the temporary credentials to the AWS IM roots. Now how I can access this IM by using AWS management console then command line interface then SDK and HTTP. IM HTTP is API. So let me tell you folks these two options are used by solution architects and these two options majorly used by developers. How I was created a user called Kiran. So once the kiran user is created you are able to get a login by using the separate credentials. So I im users are the users within the account not separate accounts. Each user can have the password to access the AWS management console. So what I created a user like K. So by using the kiran and kiran at 123 by using the username and password I logged in. So these IM accounts are not separate account. So these are the accounts within the root account. So let me tell you folks in the root account you can create up to 5,000 IM users. Now as I taken the exams Santo, Kiran, Nupur, then Prem then Anand who is responsible for what? He's going to work for KMS, EC2, S3, then uh RDS. Then finally Kiran is going to work with the billing like that what I taken the example. So this is all about the IM. Let's move on to the next point. CLI command line interface again cloud. If I want to interact with the AWS services by using commands at that time I'm using CLI. So there are two methods we have. The first one is install CLI in your local machine in your laptop and the second one in this AWS console after search bar there is a option here the name is called cloudshell. So cloud shell is built-in command line interface which is provided by AWS. There are two methods you can install CLI on your local machine on laptop. Then cloud shell by using the built-in command line interface you can use this one. So command line interface is an opensource tool that allows user to communicate with AWS services using command in their command line shell. So if I want to interact with the AWS services by using commands at that time I'll use CL. How to set up a CLI in my AWS console? Just type AWS configure and provide the access key and secret key. Once you provide the access key and secret key, if you want to programmatically access AWS resources at that time, we required access key and secret key. Region name you can if you are if you're working in North Virginia, you can specify as North Virginia. Then default format always default format will be JSON. If you want to change to text or a parakeet, it's up to you. If you want to change, you can work from there. So this particular slide is not for you people. If you are already user of a CLI, so you have to just copy that particular file from the library and paste it in the tab. This is not record for you. Now you can see now has created a user called K. And now the user is called frame. So how to generate access key and secret key. Here we have the option called security credentials. If you want to enable MFA for your account, you can enable here. If you want to generate the access keys, you can create a here. Let me create a access key. So for what purpose you are using? These are the different multiple use cases. Now for what purpose we are using? I'm using for command line interface. Then confirm it. Next description blah blah blah blah blah blah. Next. Let me create the access key. When I click on access key, you will get very important message. This is the time only that the secret key access key can be viewed or downloaded. you cannot recover it later. However, you can create a new access key at any time. So now you can see access keys are successfully downloaded in my local system. So now let me go to the cloud shell. What is the command we are using? AWS. When you type AWS configure, it ask for access key and secret key. This is my access key. Copy it. Paste it. This is my secret key. Secret key. Paste it. Okay. Enter. So default region name I'll keep blank right now and the output format I'll I'll keep blank. So folks here I'm successfully logged with premium im credentials that means what are the permission prem have so prem can perform all the task. If prem don't have the any authority like prem don't have to access the S3 bucket then you will get a clear message here. You are not authorized to perform this task. By doing this you are getting you are going to work with the CLI by by using access user secret here. This is the first method. So what what about the second method AWS CLI install? Now here is the option installing and updating the latest AWS CLI. Which operating system do you have? Linux, Mac, Windows. Select that OS and here you will get all the systematic steps they are given and you can follow and install a CLI on your local machine in your laptop. Let us start with compute and related features. So as you know that in every session you will get a scenario a day in the life of cloud architect. Now you are a cloud architect for an IT company with multiple cloud-based applications. The organization has encountered routing challenges that have result in a significant financial losses. Hence, you have been asked to ensure that such issues are proactively prevented in the future. By the end of this lesson, you will have a concise understanding of crafting routing requests, creating EMI images, Amazon machine image and exploring the types of load balancer. So now what are the learning objective? By the end of this lesson, you will be able to create an AMI Amazon machine images for fast deployment. Launch and connect to a Windows instance to enable disaster recovery. Deploy various load balancer to improve scalability. Create a routing request in application load balancer to enable pathbased routing. So these are the learning objectives. Now what is EC2? So in the previous session also I was discussed about the elastic compute cloud EC2 it's a virtual machine. So actually EC2 here uh let us consider we have user right. So now a user is taking one virtual machine on a run where in AWS environment right. So EC2 elastic compute cloud is a web service that provides a scalable compute capacity in the AWS cloud. So now as you know that in the previous session I was discussed about the compute. Compute is all about processing where you can process your scalable data like sometime it's high sometime it's low as per your user requirement you are going to process the data. Now what exactly this compute here? So you are being a user you are taking one machine on a rent in the AWS cloud and how many hours how many minutes how many seconds you are using based on that you are going to pay for it that is pay as you go model now what are the benefits I'll get if I'm using EC2 instances first easy to increase or decrease the storage capacity in a minute so now there is a concept called autoscaling okay we are talking about storage right when I am expecting a huge amount for my application This is my application which is available in a server. Right? So now EC2 will increase or decrease the storage capacity in a minute. When my EC2 is expecting some high traffic for the applications, automatically the storage capacity will be increased. When I'm expecting low traffic for my application, automatically the storage capacity is also decreased and it launches a thousands of server instances simultaneously. Here we have the concept called autoscaling group. So what is autoscaling group? Here a multiple EC2 instances you can launch within a single minute and the concept is called autoscaling groups. Now flexible cloud hosting service. So now you can launch the numerous operating system instance types and software in a minute. Numerous operating system means like if you want a Windows operating system, uh Mac operating system, Linux operating system, Fedora operating system, which one you want you can select as per your requirement. instance type like here we have general purpose instances then storage optimize instances there are different instances we have now software in a minutes even if you want to install any software in the EC2 instances that you can perform within a minute so folks in the previous session I hope everyone remember I was taking the comparison between your onremises server and a EC2 machine where being a network engineers where everyone is very excited to choose a different configuration right so like that In EC2 also you have the authority to select a configuration. What type of a memory you are going to use? What type of CPU which which CPU you're going to use? What type of instance storage do you want to use? And what about the boot partition size which is best for your application and operating system. Even if you go for your on-remises server also if you want to install your operating system you'll create some partitions. So like that here also if you want to make that kind of a partition that is also possible. Now AWS integration. Now this EC2 is integrated with many other AWS services like ES3. So S3 is what type of a service folks? Storage RDS database. So now this EC2 is integrated with ESD, RDS, SPS and even more services. Now, so now folks, reliability and security. Now EC2 provides a highly reliable environment where the replacement of instances can be quickly and consistently deployed. See replacement of instances can be quickly and consistently. There is a concept what I discussed autoscaling group. Let us consider here I have four instances. If one of the instance is unhealthy at that time AWS will automatically replace this unhealthy instance with the new one and that two consistently it will be deployed any without any downtime. Now user can easily create a secure and robust network to run their EC2 instances using the virtual private cloud. Now all the services you are deploying in the EC2 let let us consider EC2 RDS3 everything you're deploying in this area. So that's why we are creating a secure and robust network whether you are deploying EC2 RDS or anything into this virtual private cloud. Now low cost AWS charges user in seconds. They only pay for what you use. The rates are lower than existing onremises infrastructure. How on promises server being a network engineer you have taken the suggestions right? So finally we are concluded with EC2 is the best solution. Then here you will get the complete control on your instances right even you have access for the root to all the instances. So now user can use uh APIs which is already designed by the AWS. If I want to stop the EC2, if I want to start the EC2 and even if I want to maintain a data in the storage and again if I want to come back, it should start from the same state. There is a concept called hibernation. There is a concept called hibernation. Even if you want to store a data and again when you start it back resume it back again it should start from the same position where you have left that is also possible with the hibernation consent. So the thing is every operation whether it is stop, terminate, hibernation or start anything everything is happen by using the API which is already created by AWS. Right? So these are the benefits of EC2. Let's move on to the next topic. So now we have the topic called EC2 storage. How this EC2 can use with the different storage types. So here you can see I have the EC2 different storage option. First one is EBS instance short EFS and ES3 with EC2. So let me tell you folks first I'll take up this explanation for the different stoages how we are using with EC2. After that I'll do the comparison. As you know that there are different options are available. The first one is ABS elastic block level storage. This is my EC2. This is my ES2 and this is my elastic block storage EBS storage right. So as you know that folks EBS is a block level persistent storage. Now it allows user to create a EBS volume then attach this EBS volume to EC2 instance. So now this EBS which provides a durability and data persistence. So because of that reason this is suitable for if I want to store some critical data at that time go with EBS. Let us consider if I want to deal with the database go with EBS and the very important if you want to install your operating system go with EBS because this EBS volume is connected with the EC2 and that too here it provides low latency communication latency in the sense delay and high IO operations. So this is for EBS. Now, now what about the instance store? So folks, let me take one simple analogy called RAM. This one if I talk about the analogy, let me take SSD, right? So now folks, RAM as you know that RAM is a temporary storage. It like here also instance store is temporary storage option which is provided by EC2 and it provides high IO performance. So that because of this reason this is best suited for temporary data. So caching is the best example. If you want to go for caching purpose at that time you can go with instance store. Now let me take one scenario. Let us consider let us consider vimal Singh is using one desktop system. He's working on ABC.X there is no backup for this system and suddenly power cutff and the document is also not saved. What will happen? Data lost. So whatever you have the data in the instance store in the RAM everything will be lost. It's not recoverable. Now same scenario let us consider vimul singh is already the document is stored. Now when it is not stored it's available in the instance store. When the document is already stored then it's available ins. So now there is a sudden power cutff. Is it possible to retrieve the document? After saving the document is it possible to retrieve? Yes. Because the data is stored in a persistent storage. Persistent in the sense it's like a secondary storage service like SSD. that is the reason you can again retrieve the particular document. So this is the comparison also with the EBC EBS EC2. Now EFS EFS is a scalable managed storage service and here these are multiple EC2 instances right first second third and fourth. So now you can mount with the multiple EC2 instances. Now you can see this EFS file system where I'm going to work with the multiple EC2 instances. So because of that reason, it makes a suitable for the application which requires shared access to the file across the instances. Now if I talk about the use cases, the first one is let me take content management system CMS, right? Let me take okay development testing environment. Now let us consider the development environment where the multiple developers are working from a different EC2 and finally the software will be stored in this EFS. This first developer is working on first module second is working on second, third, fourth and finally the results are going to be stored in this EFS file system which is a shared file system. Let us consider for a social media for a one person or multiple EC2 instances are maintaining some data like personal information then a professional information then activities then comments a multiple servers like multiple EC2 instances are going to be maintained a data within a single shared file system. Now S3 as you know that S3 is a simple storage service right? So now this is my S3 bucket right and this is my EC2. As you know that S3 is unlimited storage. Storage you can store any kind of a data either it is images, audio, video, photos, anything. Now but S3 is not directly attached to the EC2 but now this EC2 can store the data and retrieve the data by using HTTP APIs. Now your EC2 is not attached attached with S3 but your EC2 can store a data and retrieve the data by using the HTTP APIs. So S3 you are not going to connect your EC2 to S3 directly but if you want to store a data in S3 if you want to retrieve data from S3 S3 at that time you're using HTTP APIs. Now what about the use cases? So folks let us consider if I want to take a backup for longer time. If I want to do a archiving for a longer duration at that time we are going to use a just3 with the EC2 option. Let us consider if I want to take a backup archiving purpose at that time I can go with just three. So these are the diff like different types of storage which is available with EC2. Now let me take the difference between these storage classes. EBS is what kind of a storage? block level storage and this is empiral means temporary block storage. Next, what about the EFS file storage? Then what about this? Yes, three object level storage. Next, if I talk about the capacity, see here the capacity will be up to 64 TB. Then here it depends on the instance type. Your instance store will be depend on instance type. This is unlimited. And here also it's unlimited right. And now here this is persistent storage. This is persistent. What about this non-persist? This is also persistent. And the fourth this is also persistent. Now how many EC2 I can attach here? Single. What about this here? Also single. And what about this multiple and what about this? Yes, it accesses through using HTTP APIs which is created by AWS. Now the final difference let me take with the use cases. So I can use for okay if I want to install operating system databases at that time I can go with this. What about this caching? Next, EFS, shared files. Where you want shared data at that time, you can go like CMS, social media, development environment and even more. Next, can I go for backup? Can I go for archival? Can I go for web applications? Can I go for big data? Folks, I'm talking about the S3. Can I go for web application? Can I go for big data? There are a lot of applications we have for S3. If I talk about uh the pricing model, so here pay per provision size and here this is related to instance type and if I talk about the file storage pay per usage that means how much storage you are using and what is the throughput of that and here for object level storage we have a different storage classes how many days you are storing a data and that to in which storage class you are going to pay for it right so it's all about the storage request and uh how much you are utilizing that based on that you are going to pay for S3 with EC2. So this is all about differences between the different storage classes and the explanation of everything. Let's move on to the next topic called instance types. There are different types of instances are available for us like a general purpose instance, compute optimize instance, memory optimize, then accelerated computing and storage optimize. So now you can see there are different types of instances with when should I use which instance type right what are the use cases and what are the different uh instance families are available. Now the first one is general purpose instance generalpurpose instance as you know that instances are virtual server in AWS cloud. So now this EC2 offers uh various instance types which allowing to select your CPU, memory, usage and even networking which is required to run your application. So now folks this general purpose instances are very much useful to design the web server code repositories that require these resources in a equal parts. Now you can see here we have the example of instance type like T 4G this one T stand for general purpose. Now that to a general purpose bustable performance this is processor version version 4 and G is nothing but gravity and processor. So let me tell you folks AWS supports uh three different types of processes. First A, second G and the third one is I. A stands for AMD, G stands for gravitian and I stands for I stand for Intel. Recently AWS has added the one more processor. G is gravitonian. First AMD G gravitian I Intel. Like last month AWS has added one more processor called B200 which is accelerated by Nvidia Blackwell GPU. Now the next one is compute optimized instances. So now compute optimized instances are suitable for compute intensive applications that benefits for high performance processor. Now when should I use this? Let us consider I'm dealing with batch processing workloads where I have a huge amount of a data then dedicated gaming servers scientific ad server engines and scientific modeling and so on. So now C7G that means compute optimize 7 is processor generation gravitian processor C6 I six processor Intel so where you don't have the processor you can use any type of the processor memory optimized instances memory optimized instances are intended to provide a rapid performance for a workload that processes for large data set in the memory so when you are going to process the large data data set like a databases like electronic design automation workload realtime analytics so folks any example for realtime analytics can I consider stock market so stock market or a trading platform are the best example for realtime analytics now realtime caching servers folks can I consider live streaming like YouTube live Facebook live where catches the content to the users and here is the option R5 A. So R is nothing but a specific memory optimized instance type with the fifth processor generation with AMD processor. So always every time you have a size here the size might be a small, medium or large or 2x large, 3x large, it depends. There are different instant types are available. Now the next accelerated computing instance. So accelerated computing instances use hardware accelerator or a co-processor to execute the task more effectively than software which is running on CPU from 2005 to 2010. If my processor was not supporting high definition games like I was trying to add something to my laptop or a desktop system especially I'm talking from 2005 to 2010 10 where the processor would not support some high definition graphics card. So folks can I call this graphics card is like a co-processor in that system. So now here also it acts like a co-processor to execute your task effectively then which is running on CPU. Now for which task you can use. I can use for floating point number calculation, graphics processing, data pattern matching and even so on. Right? So here we have P4 accelerated computing with the fourth generation you can use. Nowadays Nvidia has provided a separate processor for that. Now yeah one more thing G4DN. So now G4DN so G is for graphic intensive with the fourth fourth processor generation and here this indicate the specific option and this is additional capability with Intel or AMD or any kind of a processor. Now, storage optimized instances. Storage optimized instances are designed to provide the application with tens of thousands of low latency random IO operations per second. Now, what kind of a workload you are going to consider? Let us consider when I have the high sequential readr access to the large data sets on a local storage. Any specific example folks for this where you are performing uh sequential readr write access from the large data set and that to which is available in a local storage IRCTC in memory DB stock market prices online banking now you can see there is a storage thing here this is my instance family C7 GN this entire we are calling it as a instance family C is nothing but series this seven is nothing but generation and these are The options these are the additional capabilities. This entire thing we are calling it as a instance family and this is size and this entire total family along with instance size we are calling it as a instance type. Now C4 compute everything the all abbreviations are given CD FGH everything and here you can see AMD Nvidia V200 gravity and Intel processor right these are the different processor which are available for us. Let's move on to the next topic called AMI like Amazon machine image AMI which contains the information about the EC2 instance what you are going to be launched now what kind of a information like which operating system you are using then which elastic block storage you are using which instance type you are using right which security groups you are using everything you'll get the detailed information in this template right so now folks by using the same AMI if I launch one EC2 instance so the configuration will what you define it's available now is it possible like if I use the same template if I launch the multiple EC2 so the configuration of the EC2 will be same or different same because what you have the template here if you are using the same template to launch your EC2 instance if you use for multiple EC2 the configur ation will be same. If you want different then you have to create a separate template for that. For example, for Windows is different, for Mac is different, for Obentto is different. Like this you can create. So AMI is a virtual instance that includes a templates for the root volume of your instances even which consist of a launch permission to control the AMI launch instances and even a block device mapping for the specific volume which are attached to this particular EC2 instances. Right? So now here we have one simple diagram. So now you can see if you want to create a AMI within the AMI you have to use the EBS also EBS snapshot. Snapshots are nothing but the backup right. So when you try to create AMI so first you have to register this and by using this AMI you can launch a EC2 instance. That means you can create a EC2 instance. By using the same AMI you can copy this AMI from one region to another region. Let us consider now if you're not using that AMI then you can dregister or delete that AMI that is also fine. How we are going to create a AMI? What are the methods we have? There are three methods. The first one is private and the second one is specific AWS account and the third public. Right? Let us consider private. private in the sense when the users let us consider the praep is created one AMI so this AMI will be used by only Praep because he created that AMI which is available in a private right no one can access this AMI that's why we are calling it as private now specific AWS account let us consider Praep has created one AMI and he want to share with the specific account let us consider Gagandep is available with the 456 account and Praep is available with 1 to three If you want to share with the specific account, you can go with specific AWS account option. Now, if you want to publicly share your AMI where anyone can buy and sell the AMI, there is a place called AWS marketplace. So, let me tell you folks, AWS marketplace is the place where you can buy and sell AMI. It's like a Ox but here AWS marketplace is the place where you can buy and sell the AMI. So who all are there like community members some third party users some of the AWS experts community members right and even a third party users and even you also available here so you can create your own AMI and you can sell that is also possible in the AWS marketplace so first is private then specific AWS account then public now let me show you the first lab of your AWS solution architect associate post. So here launch instance and the name is let me give the name called demo server. Okay. Now here you can see am I Amazon machine images. Here we have for Linux, Mac, Ubuntu, Windows, Red Hat, Susi Deb. Just now I click on this launch instance option. know any other steps folks let me give demo server you can provide any name here you can see AMI Amazon machine images right Linux and even more so if you want to go for more browse more AMIs then click on browse more AMI you can see quick start AMI 45 my AMI is zero because I have not created any AMI here that is the reason it's zero AWS marketplace 6,838 8 AMI some of the AWS and third party trusted AMIs community AMIs published by anyone 500 AMIs. So here is the place where you can buy and sell your AMIs. Right now let me go back. Okay. Now click on launch instance and here provide the name called demo server. Okay. So now folks if you see here in the AMI list there are multiple AMIs are available in Amazon but for practice purpose only Linux 2023 kernel 6.1 AMI is available where you can see entire things 16 64-bit architecture AMI ID then virtualization HVM enabled Android devices EBS elastic block storage which is attached to this AMI. Now let me select this free tier eligible. Here you can see the architecture. So there are two options are available x86 64-bit x86 and ARM processor. So now I'll go with x86 architecture. There are different types of instance type what I completed before AMI the topic t3.micro t2.micro are you able to see this t2.lar large T3.micro everything everything the different types of instance types are available general purpose compute purpose accelerated computing storage compute optimize everything all the instance types are available right so let me tell you one more thing even if the instance type is same for a different operating system the charges will be different now you can see for T2.micro T2 family one virtual CPU 1 GB of a memory current generation is two for Windows 0.0162 USD per hour Ubuntu is different then source is different Linux based pricing is totally different so like this for every operating system the different pricing will be there right and the very important folks always you have to use T2.micro not T3 if you use T3 then you are not able to launch your EC2 instance this is for instance type now folks keep here keeper is like a additional security for your EC2 instance. So if you want to connect your EC2 instance by using CLI or SDK at that time this keeper are required right. Keep pair is like a additional security for your EC2 instance. Let us consider uh Yomi. Yomi is one of the software engineer who is working in one of the MNC and right now he's located in Mumbai. Because of some work he's shifting to uh another city. So at that time he'll lock the door. First he lock the door of house. Once they done with the main lock then he locked a gate also for additional security like that. Here also along with the security groups we are providing a key pair. But make sure that when you create a key pair it should be kept in a safe place. If someone will get the key then you are gone. That is the reason I'm talking about the industry industry example industry relevant examples. For example, now you're working in a development environment, right? In the development environment, you have one EC2 instance and you forward that keep pair or someone got the key pair. Then easily they can connect and destroy your entire architecture. Now, right now, I don't have any key pair. If I want to create a key pair here is the option the name is demo. There are two different types of key pair we have RSA and ED251. These are the two different types of keys which are available. Now private key format. So do you want to go for PM or PPK? Folks, PPK is like a older concept now because for this PPK we need a third party application called Puty. So that is the reason we are not going with the PPK. Now let's go with PM directly. We can utilize. So once I click on create key pair, you are able to see a key will be downloaded on my local machine. Demo 12 PM key is successfully created. All right. So now the key is successfully downloaded. Now folks in local machine can you see this demo 12.pam is successfully downloaded here. So whenever you are connecting your AC2 instance you have to import from the particular location then you are able to connect right now setting folks keep as it is don't touch any of the option. So right now no need to think about this just keep as it is everything as it is. Okay, let's launch EC2 instance. Okay, now you can see successfully initiated launch the instance. I am ready with my instance now. You can see here folks the name of the server, instance ID and which is running now. And here you can see initializing status check is initializing. So here you should get 2x2 check pass that means your AWS will check a system check and instance check. So system check with all the configuration is fine. Now instant check whether the instance is successfully deployed on the system. Everything will be checked here. Once everything fine then you will get 2x2 check passed. Right now this is your demo server. Let us consider I want to create a image of this particular server. So for this you have to select the server. I am going to create the image that means same configuration one more template. Let me go to the action and here is the option called image and template. You have the option called creating. So in this image I'll give the name called example description blah blah blah blah blah blah. See reboot instance it's up to you. When you select this your EC2 will be reboots. The instant data is rest when the snapshot of attached volumes are taken. So it makes sure that the data is consistent always. So when your EC2 reboots right so data will be available the snapshots which are available in the persistent storage here. Now you can see the EBS value which is attached to our previous EC2 because in the previous EC2 the size was 8 GB. If you want to change the capacity it's up to you. If you want to change the value it's in your hand. If you want if you want to increase or decrease it's up to you. Let's click on create image. Now you can see just now I created the image which is available in now here you can see AMI option images. What I completed folks if you click on AMI is it the same AMI what I created just now. Now let me show you in the instances tab. Instances tab. So now click on launch instance one more time. Let me show you one interesting fact. Earlier my AMI was zero. Now the new tab here I have my AMI. Let me click on this. When I click on my AMI, is it the same AMI what I created just called example folks? Right? Even if you go for browse more AMI in that my AMI was zero now it becomes one created by me just now I created a AMI with the description what I given example is the name is it available for me. So by using this AMI you can launch uh multiple EC2 instances. This is overall demonstration for AMI. So now let's move on to the next topic called placement groups. So folk placement group is one of the feature that enables a user to deploy a interdependent instances to handle your workload in a more efficient manner. If you have one EC2 instance that means based on the configuration its capabilities it can provide the results. When I'm using placement groups where I'll get the multiple EC2 instances and that too each are dependent on other and by using the capacity and capabilities you are going to deal with your workload in a more effective manner. Right? So here we have some important points. So up to 500 placement groups per account you can create and always a name of placement group should be name should be unique and it's not possible to merge a placement groups. Now there are three different types of placement groups are available in that the first one is cluster partition and spread. uh for the placement group I have one custom diagram document. So what is this custom diagram? Let me tell you I'll use this custom diagram to provide a in detail information how logically works your placement groups. By using this diagram you can easily understand as I discussed this placement group consist of three different categories. The first one is cluster, second is partition and the third is spread. Now what is cluster? A cluster placement group which consists of multiple EC2 instances but it it launches on the single or a same rack. Can I say that rack is a place where I'm going to host my servers. So now by using this single rack I'm going to launch the multiple EC2 instances. So if rack fails then all the EC2 instances will fail. That is the mainly disadvantage. Now let me show you some information. See cluster same rack in same availability zone always your cluster will work within the same availability zone and that will provides a great network low latency up to 10 Gbps bandwidth between the instances. So what is the disadvantage if rack fails? Let us consider if rack fails then all the instit instances will fail at the same time then there is no any institute which is available for us to provide a service. So when should I use this? Let us consider I'm doing with a big data job that need to complete a fast access. Some of the application with low latency and high throughput. So folks can I consider stock market as example application with low latency high throughput uh trading platform as the best solution and even the instances here the EC2 instances want to communicate with each other. So instance like a low latency communication can be done. So that is the reason you can consider the trading platform is the best example. Right? Now the next one partition placement group. Let us consider you are running one high performance data inensive application like our realtime trading platform. So now high performance data inensive application. So what we have realtime trading platform which require the low latency communication. So cluster is one which provides a 10 Gbps bandwidth compared to other options. This 10 Gbps of a bandwidth between the communication of instances. See we are talking about a low latency communication between the instances right. So here by using this solution a best possible network performance right you will get through the cluster and that is the reason we are using a cluster placement group. We have the strategies to overcome that problems. We have the strategies but you will not get a low latency communication between the servers compared to cluster. So the main focus is communication between the two instances with the 10 Gbps of a bandwidth right. So you like here in the cluster we know that how to manage your racks. In some cases if something went wrong at that time it affects but this type of a low latency communication you will not get in a partition or a spread. That is the main reason. Now partition placement group. Partition placement group folks let me tell you this is also can be used within the single availability zone. And let me tell you here the separate partition will be maintained up to seven partitions you can maintain right every partition have the separate rack and these rag are related to this partition. If something went wrong so that doesn't going to affect second and third. If second something went wrong first and third will be not affected. If third something went wrong first and second will be not affected. So here in you in your partition placement group you can launch hundreds of EC2 instances with the separate partition right. So in this partition in a single availability zone you can create up to seven partition not more than that there is a restriction right now. So up to seven partition per SD with the hundreds of EC2 instances you can launch the one instance the instance of one partition do not share the rack with the instance of other partition as I clearly discussed a partition failover can affect many EC2 instances from the same partition but it don't affect the other partition which is available in same availability zone right so now let me take one simple example for partition placement group now let us consider you are building one mission critical fall tolerance application. So what kind of application you can consider for mission critical applications banking can I consider defense weather forecasting health right these all are mission critical fall tolerant workloads. So let us consider you are building one mission critical fall tolerant application that must resolent to a hardware failure. So now to achieve this you want to distribute your instances across different different different different partitions within the same region. So using the partition placement group if one partition goes down the second and third will be ready. If second goes down first and third ready. If third goes down first and second will be ready. Now spread placement group. Fourth spread is available with multiple availability zones that within a single region. The first difference like 1 A, 1 B, 1 C and here a separate hardware and a rack will be maintained. So within the same availability zone a separate hardware and separate rack will be maintained. For this EC2, separate hardware and separate rack will be maintained. So same thing for 1 B 1 C even if one EC2 instance goes down within the same availability zone because a separate hardware and rack is there that is the reason it doesn't going to affect the next EC2 that is the power of spread placement group now let me show you so now when you click on advanc details here is the option called placement group yes here's the option to create a placement group right now I don't have any placement group in my account let's create a new placement group and let me give the name called demo No zero command. So what strategy do you want to go cluster spread or partition? I want to go with the cluster create a group. So now placement group is created successfully. If you go back here still this option is not available. Let me refresh. So here placement group demo07 strategy cluster with the shared no is available for me. So whenever you are launching the EC2 instance. So if you select the cluster placement group the EC2 will be deployed in that group and you can launch the instance and let me tell you folks by default placement group will be not selected. If you want to use then you have to create then you can utilize that. Okay. So this is all about the placement group. Now let me take you to the next topic called metadata. What is metadata? Data about data. Meta data about EC2. what you're expecting configuration details in metadata concept you will get the information about the EC2 instance like what is the AMI ID what is the instance type then what is the public host name then network what is the network MAC address instance ID profile everything you will get the detailed information now let me show you this is my meta server select the Linux operating system capacities T2 micro And here is the option. I'll go with proceed without keeper. Networking settings I'll keep as it is. Once you scroll down there is a option called advanced details. And here folks you have the option metadata versions. You can see there are two versions are available for metadata version one and version two. If you see here metadata accessible enabled but only for only for V2. If you want to go for both versions v_sub1 and v_sub_2 you can select the first option. By default it's only v_sub2 and now you can go for v_sub1 and v_sub_2 both. So let me tell you what is the difference between v_sub_1 and v_sub_2. So v_sub_1 is a simple method right there is no any authentication but v_sub_2 is token based authentication. So here first you have to put for a token then you will get the information right. So now this is V_sub1 is not secure V_sub2 is secure and V_sub_2 you will get 6 hour of session to get the responses. So token will be generated and you can perform the task right. So V_sub_1 is like just simple HTTP get request right. So now V_sub1 and V2 I'm selecting both options and now let me launch a instance. So now I'm successfully done with launching my second EC2 for meta server. Now how to connect? So now select the meta server. If you want to directly connect your server, here we have the option called connect. So here instance connect. Now your EC2 will be directly connected by using instance connect option. So this is public IP address and this is private IP address of your EC2. This is Amazon Linux 2023. Just now what I created the EC2, right? AMI along with the EC2 user. This is private IP 172 318 181 195 right. So folks again I have one document a standard URL always if you want to check the meta data of any EC2 instance we have the command called 169 254 169 254 just copy and paste it folks you can see curl http 169 254 169 254 for latest meta data right now just enter so now these are the different attributes which are available for us let us consider If I want to check AMI ID just slash AMI - ID enter. Now you can see this is the AMI ID of my EC2 instance. Right? Like this if I want to check a MAC address. So this is the MAC address of my EC2 instance. So you can check it out all the attributes whichever you want. Then you'll get the in detail information. So now examples where we need meta database. See let us consider I want to do some automatic app configuration when you want instance ID regions public IP private IP right let me take a simple example you have an web application and you want to write the logs tags in a instance ID automatically by reading your metadata at that time this is very much useful right even you can use in fetching temporary credentials like IM ro then auto discovery right bootstrapping in that case which is very important Let's move on to the next topic called a topic is EC2 purchasing options. We have the different EC2 purchasing options in that the first one is on demand. Now what we are using if you are not selecting any of the plan then by default it's on demand only because here we don't have any upfront cost. There is no any upfront cost and even this is very much suitable for short time short-term workloads. Now the next one is in saving plan you have to commit for 1 or 3 years and you will get the discount 65 to 70% of a discount compared to your on demand instance. Now reserved instances here also one or three years of a commitment but you will get a 72% of a discount compared to your on demand instances. Why? What is the difference between saving and reserve plan? Let me tell you folks in saving plan if you want to shift from T2 to M3 or MT M3 to R4 it's possible to change the instance family. But in reserved instance if you are using R4 you have to use only R4 for this entire 3 years you don't have authority to change the instance family right now might be you have the question sir where I can use this in which use case let us consider pranit is one of the solution architect for IRCTC organization right so now pranit know that I'm going to get the this much of a traffic that's why I decided to use R6 dot large for this IRCTC application. Now this R six bit.l large application can run for 3 years. 3 years because tranit know that for 3 years I'm going to get this much of a traffic. So that's why I decided to use R6.lar even I already know that this much of a traffic I'm getting that is the reason I'll select a high-end instance type. So you can't change this but saving plan let us consider my workload now I'm using R six here but what I expected I'm not getting that much of a workload so you can downgrade your instance type from R6 to T4.large large. So you you are doing cost optimization by reducing uh downgrading your instance type that is nothing but saving plan and reserve instances. Right? Now the next is spot instances. So folks in spot instances you will get the 90% of a discount. Now why I'm getting 90% of a discounts? What is the reason behind that? So here in the different plans those who are the clients those who are selected the different purchasing options some of the capacity or memory which is not used that is surrendered to AWS. So that kind of a space will be allocated to the user. Now how exactly this spot instances work? Let me take with the single example. Here we have one hotel or lodging facility. Let us consider this is hotel and lodging facility we have and here we have one manager. So folks in this hotel we have 100 rooms right? So all the 97 rooms are occupied with the 1,000 amount 1,000 rupees amount right now these three rooms are vacened. Three rooms are vacened and after 24 hours also no one is occupying this rooms. So manager is thinking what happened right now suddenly one person will come and he'll ask for this room. Hey, can you give me this room? I'll pay 400. Everyone is already given 1,000 rupees for a single room. Now he's asking for 400. Now manager is going to put one condition. Okay, I'll give the room. But there is a only one condition. What is that? Someone will arrive with the value of 500. At that time you have to leave the room. So same thing in spot instances. Let us consider for viml the space is allocated. Now suddenly Satya Prasar will come into the picture. So now the space is allocated to Viml Singh right and now Prem will come into the picture and suddenly Vimal is bidding. He's taken the space for $200 and suddenly Prem will come into the picture. He bid for 300. Now AWS will send a notification to whom? Vimmel Singh. So this space is allocated to someone else. Please complete your task and before 2 minutes you'll get the notification from AWS that is the reason you are getting 90% discount right so once the two minutes completed this space will be allocated to prem can utilize this space and because of this reason AWS is clearly specified don't use any complex data or mission critical data or important data for spot instances because before 2 minutes it will be terminated Right? And when should I use this? The best example is batch processing. Why? Because where you left the last process, you can start from the same place. That is the reason for batch processing. The best example is our spot instances. Right now, let me take the last option. Dedicated host. Dedicated host. If I compare with all the options, dedicated host is too costly. dedicated host is too costly. Why? Because a entire physical server will be provided to a single customer. So entire physical server will be provided to a single customer. Right? So here you control your placement of virtual machines instances of the host. Right? So performance is same as your instance family. Right? But here you will get a more predictable performance defense system right when you have some compliance requirement right dedicated host means let me take one example you you need to run one windows server with your own license so at that time you use a dedicated host to comply with your Microsoft licensing rules right so these are the different plans which are available for EC2 let us start with hibernation Any idea what is hibernation system in sleep mode? Uh what is the goal of that particular hibernation process? What you are achieving by doing that? Hibernate your EC2 instance. Again you can start from the same state where exactly you have left and the very important you don't have to pay for the hibernation setup for that specific duration. You are not going to pay anything. So hibernation is a process where your system is going for sleep for a certain duration and when you resume it back again it start from the same state. Now here we have a diagram here you can see I have an EC2 instance along with the EVS. All right. So the first condition is if you want to do hibernation for your EC2 instance make sure that your EBS should be encrypted otherwise it's not possible to hibernate your EC2 instance. Now operating system sends a signal to the system. Now stop hibernate. Stop hibernate means now it starts from the stopping process to stop process. From stopping to stop there is a process. What is process in operating system? Process is a program under execution. And what is that execution? From stopping to stop shape. Now your EC2 is successfully hibernated. This is my EC2. after EC2 stop my EC2 is hibernated and this EC2 is attached with EBS and instance store right so now folks my question is when my EC2 is hibernated am I going to pay for it no 100% no but you are going to pay for only the EBS value because EBS is a place where it stores a current state of the system that is the reason you are going to pay for the EBS S value and the one more thing whatever you have the data in the instance store as you know that instance store which acts like a RAM a temporary storage when you hibernate your EC2 instance all the data will be vanished totally the data will be deleted and only the EBS data which stores your last state of the system and even when you reserve it back it start from the same state right so here instance store is nothing but temporary storage it acts like a RAM Now when you hibernate your EC2 instance all the data will be vanished from the EC instance store but when it comes all the data will be available even you can start from the same state where you have left. Now when you hibernate your EC2 instance even the public IP is also changed the private IP will be same. Now let us consider if I want to make my EC2 instance should not change the public IP then we have the concept of elastic IP. So folks elastic IP are the static IP addresses when you allocate to your EC2 instance even if you are hibernating also then it never change the IP address and these are chargeable. Now there are multiple things we have like if I talk about the EBS value even if you are doing a hibernation of your EC2 instance if you want to do any modification related to EBS that is possible if you want to do some optimization settings for EBS that you can do that right and this hibernation is supported by the new operating system what we have these are the features of hibernation now if I talk about some limitations also in that the first one is when I am hibernating my EC2 instance all the data from instance store will be deleted. Now the next let us consider if I have uh more than 150 GB of a RAM in that situation it's not possible to hibernate as per the architecture AWS clearly specified if you have more than 150 GB of RAM at that time it's not possible to hibernate and the next let us consider folks if your EC2 is hibernated for 60 days then AWS have the authority to terminate that instance. Let me show you in the console. Now let me launch the instance. I'm going to show you the hibernation option now. Okay. Now, now let me give the name called demo. Proceed without keeper. Right. So when you click on advanced details here we have option called hibernation. Here you can see there is a option stop hibernation behavior. It should be stopped. So first you have to enable. If you enable then only you are able to hibernate your instance. If you are not enabled while launching the EC2 then it's not possible to hibernate your EC2 instance. And now what I'm doing hibernation behavior is enabled and it should be stopped. Now let me launch the instance. Just now I got the error. Why? What is the reason? The reason is your EBS is not encrypted for hibernation. The root device value must be encrypted. Edit the instance configuration. And where is your EBS value before advanced detail? Here we have the configure storage option. Click on advanc. And this is the value EBS value. And here you can see encrypted not encrypted. Right? Let's encrypt now by using default KMS key. So what is that KMS? I'll discuss here. KMS stands for key management service. It's a centralized repository where we are going to maintain a cryptographic keys for encryption as well as decryption. Now I'm using default key. Okay, let let me launch the instance. So now my EC2 instance is successfully launched. Let me show you folks. Still it's pending. Yeah, now it's running. Usually if you go to instance state, right? These are the options. Let's select the server and here instance rate. So usually this option is disabled until and unless you have to explicitly enable that. Right now if you click on hibernate instance click on hibernate. I got the error. Why? What is the reason? Because my server is still initializing. If once it's 2x2 check pass then you are able to hibernate your EC2 instance. So this is all about the demonstration for uh hibernation process. Let me hibernate your EC2. Now let me hibernate. So select the server and here instance state hibernate instance. I'm done with the hibernation. Now folks this running become stopping and once the stopping will change to which state from stopping to stopped state. So what is the difference between stopped and hibernate? When you stop your EC2 instance, all the data will be totally deleted. It's not possible to take from the last state. But when you hibernate, it's possible to take from the last state of a system. Right? So now even you can see here folks. So now you can see here from stopping to stop successfully my EC2 is stopped. So if I want to again start the instance by using the start method again I can start from the same state. So this is the way how we are performing hibernation. Now folks, we have the topic called EBS, elastic block storage. So here you can see I have the option called advanced details. Right before this we have a configure storage option. Click on advanc. And here we have a different storage a different volume types. Storage type is EBS and this is the name and snapshot that is nothing but backup. And here is the size. So here folks, you can see there are different volumes we have. What are those? The first one is uh EBS. So now let me take you to the EBS volume. Folks just see here the different volumes are available folks. Here you can see the 8GB. You can change the size and the volume type. Here we have the different volume type. The first one is solid state drive SSD. Then the general purpose SSD provision IOPS SSD right. So apart from this we have a magnetic standard and then hard disk drive. So why we are shifted even from even if you check it out our laptop also why we are shifted from hard disk drive to solid state drive. What is the main reason? Because it's too faster which improved the IOPS input output operations per second. Right here you can see uh SSD we have two categories GP3 GP2 IO1 IO2 so these are general purpose GP3 GP2 are general purpose SSD which provides up to 16,000 IO and the capacity of GP3 and GP2 is from 1 GB to 16TB and when should I use this for example I'm dealing with some low latency applications like our development and testing environment at that time you can go for GP3 GP2 now if you go for provision IOPS SSD IO1 IO2 let me tell you folks it provides uh 64,000 IOPS per value and now when should I use this when I want a workload which requires a more IOPS more than 16,000 at that time you can go with IO1 and IO2 usually we are going with IO intensive database workloads right and the capacity will be from 4 GB to up to 16 TB what we for I1 and IO2. Now if I compare with hard disk HDD, hard disk SC1 or ST1, there are two options are available here. The size will be 25 GB to 16 TB. And let me tell you the IOPS rate only 500 IOPS per volume. So general purpose which provides a 16,000 IOPS. This is 64,000 and this is only 500. Now how many number of input output operations per second your EBS volume can perform. So now you can customize as per your requirement. So delete on termination when you terminate this uh EBS volume will be deleted. Now encryption as I discussed just now if you want to encrypt a value it's a optional but when you are going for hibernation it should be mandatory. Here we have a default key. If you want to go with the custom key, key management services is a centralized repository where you are going to maintain a cryptographic keys. So here you can create your separate customer key and without sharing to anyone at that time for more security purpose if you want to share with the client at that time you can use that particular keys also by using KMS it's possible. So this is all about the EBS value what we have in our AWS environment that for EC2 launching machine. If I talk about the concept called load balancer. Now we have topic called elastic load balancers. Uh what is load balancer? Let me tell you what exactly it is. Elastic load balancer. It distribute your incoming application traffic across the multiple targets. Now the target might be any EC2 instance, containers or any lambda function. In our scenario, the targets are EC2. So now folks, so here we have features. The first one is load distribution. Now here we have 100% load for this load balancer. Target means EC2 instance, container or any lambda function. See lambda is also one of the compute service. EC2 you know that containers it's a standard way to package your application such as code dependencies runtime repository into a single object that is container lambda is nothing but serverless compute service so now the target might be any EC2 container or any lambda function right now here we have 100% load the first one is load distribution right elastic load balancer is responsible to distribute a load equally to resistor targets. So now it starts dividing the load 33%. 33%, 33%. Might be you have the question sir what about that remaining 1% that is also equally divided. The next is all tolerance right. So now elastic load balancer it sends some heartbeat package to check whether the web server is active or not healthy or not. When load balancer sends a hardbeat package to the server if suddenly you got the acknowledgement that means ELB declared as this web server is healthy like that this web server might be busy to provide a service to other customer. So you now in that situation you can say that the server is not healthy for that we have the concept called interval. So now I'll put the 2C interval. Let us consider prem is busy in doing the breakfast right I'm continuously taking prem name prem I can't wait up to evening because prem is busy doing breakfast I can't wait up to evening once till free then I'll get the acknowledgement no I can't wait so because of that reason I'll specify 2 second interval along with uh 2 minutes of a duration if I'm not getting with the 2cond of intervals praying praying frame frame frame after 2 minutes also then I'll declare as frame is not available this web server is unhealthy the server is not able to receive the traffic then I'll declare as unhealthy again load distribution again we have the 100% load now it starts equally dividing this load 50% to this 50% to this why because the first server is unhealthy D then the server one server two equally handle the traffic from a load balancer. Now the third point security how this load balancer provides a security. So now when a client is requesting to the elastic load balancer load balancer will equally divide the traffic. Right now after equally dividing the traffic from where exactly you are getting the responses client is not going to understand because of security reason elastic load balancer it hide the public IP of the web server from where exactly you are getting the responses the customer is not going to understand that that is third feature of security of your elastic load balancer now if I talk about the benefits elastic load balancer are highly available secure, scalable and even flexible also. Now here we have three different types of load balancer. Yeah, the first one is application load balancer and the second one is network load balancer and the third one is classic load balancer. So are you people familiar with the OSI model? A P S T N DP application presentation s transport network data link and physical. So now which is the first layer physical layer. So no need to go in detail about the OS and networking layer uh model. So just this is physical layer data link network transport session presentation and application. So now here we have application load balancer. So let me tell you folks here it deals with the HTTP and HTTPS traffic using the application load balancer always it routes a traffic to the targeted within the VPC based on the content of the request. It route it routes a traffic to the targets within uh VPC based on the content of the request. Right? And let me tell you folks in which layer it works. Layer number seven that is application layer. Now network load balancer NLB. So folks, network load balancer which deals with TCP UDP traffic and here also it routes uh traffic to the targeted VPC regardless of the content request and do you know folks in which particular OSR layer it works network load balancer always it works with the transport layer fourth layer and now this classic load balancer is the combination of both HTTP and as well as TCP that's why it works in layer number seven as well and layer number four also TCP UDP are like see classic load balancer is the combination of both application as well as network load balancer. Now folks let me show you the same thing in the console how exactly your load balancer works. If you check it out the first step, you have to create a security group. Right? Now, this demo is for creating a load balancer with the resistor targets. So, first you have to create a security group. Now, then you have to launch the instance with a different availability zone. Then how to launch a instance in a different availability zone that I'll show you. Then after that, I'll show you how to create a load balancer. Then how to deploy this classic load balancer to the EC2 instance. Now what is the first step? You have to create a security group. Let me go to the console. And if you check here, there is a option called security groups. See here we have a option called security group. So now folks, click on security group. Folks, security groups are the virtual firewall at EC2 level where you are going to define your inbound and outbound traffic. Which traffic is allowed to your EC2 instance? that you are going to decide here by specifying inbound rules. Right? Now let me take the name also the same my HTTP server. Okay. Then description. If you want you can otherwise you can leave that. Don't change anything for this VPC. Keep as it is because we are using default VPC. Now click on add rule. SSH first one secure shell. SSH is nothing but secure shell and that to anywhere from IPv4 address. Next HTTP anywhere from IPv4. Let me take one more rule. HTTPS HTTP anywhere from IP IPv4 HTTPS anywhere from IPv4. Even I included HTTPS also. Right? So now the traffic from SSH HTTP HTTP is allowed to my EC2 instance. Now let me create a security group. Now I'm ready with my security group called my HTTP server. So what is this second step? The next is launching the instance with the different availability zone and that to Linux to operating system keeper. See keeper is not required. Let me take the name called HTTP server one. Okay. Now let me launch the instance. So now let me take the web server one http server 1 the name and here Linux operating system 6.1 AMI 6.1 is fine and now instance type is t2.micro okay and here keep your not required because we are not using not required folks if you see the networking setting right how to deploy what is the condition you know that how to launch a EC2 to instance. You know that. But how to launch a EC2 instance in a different availability zone. For that you have to click on edit. And here you can see the subnet options. Keep VPC same as it is default subnet. You can see the availability zones. 1 B 1 C 1 F 1 A. Right. Right. You can select anything. You can select any of the availability zone. So now I'm selecting 1A. So now firewalls. Do you want to use firewalls? Yes. I think just now I created one security group my HTTP server. Select this and along with a default one. Default where I want to provide a more granular permission to my EC2 instance. Now EBS I'll keep as it is. Advanc details. Right. So here we have user data section. Let me let me show you the document. Okay, let me explain folks. Here you can see now here we have a script that to bash using the bash cell we are providing a script now. Right? So I'm going to add user data section. Right? What is user data? Now if I want to do the automation let us consider automatically Apache server should be installed and the operating system should be start. So at that time I'll use the user data. If you want to do some automation kind of a things like here are the commands automatically the Apache server should be installed and then it should be ready to use. Now the first two lines are you can see command lines. So now y m update minus y folks here it update all the installed packages on a instance and this minus y indicates automatically says yes to your prompt and then y install minus y httpd. So it installs the Apache HTTP server that is HTTPD using Amazon Linux package manager. Right? Then systemct ctl start httpd. It starts the Apache web server immediately. Then it starts first it start the Apache web server immediately. Then systemct ctl enable httpd. Now folks it configures Apache to auto start on a boot. Right? If the instance read starts or Apache runs at that time it is required. Now eco it's like a output like output message where you can see a simple HTML file which is homepage for your web browser right and now host name minus f. So here it insert the instances fully qualified host name dynamically. That means here what is your EC2 instance private IP address. You will get the information here. And finally this is your uh what do you call a file placed in Apache default document root. Finally the data will be stored here. Now let me copy this. Let me copy this. Open a notepad. Open a notepad and paste it. Folks, make sure that the last line should be in the previous line. See, if you are not doing this, you will be redirected to Apache homepage. If you take the last line into the previous line, then only you are able to see this AWS network web server. Right. Let me copy this and paste in user data section. My EC2 is running. Let me show you. My HTTP server is still running right now. Just now it started. So now how to check whether my server is running or not? So just go to the instance ID and here we have public IPv4 address. Copy it and paste it into the new tab. Copy the public IPv4 and paste it in the new tab. Folks, is it the message what I given in the document? Welcome to AWS network web server along with the host name. Welcome to AWS network web server with the private IP address 172 31 320 34. I am ready with the first in instance. Right? So as per your assisted practice they are clearly specified in 2.6. Repeat the steps to launch second instance with a different availability zone. Right. Let me launch one more EC2 instance. So again I have to launch one more instance with same steps only the thing is you have to change the availability zone 18 to 1B or anything. Okay. Let me take HTTP server 2. So HTTP server 2. Okay. So now same as it is the steps are same. And now all the steps are same T2.micro EPR without QPR only the modification is as per the condition we have to so as per the condition where I have to deploy now in different availability zone. So where should I deploy now? Okay, one B selected, right? So again I'm using the same security group default right my HTTP server along with the default fine now advanc details I'll use the same user data I'll use the same user data but to make sure that it should be differentiated right so for that I'll make I'll add here 2222 I hope everyone got the point why I'm differentiating. I should know for which web server my load balancer is hitting. Right? Let me launch the instance. So how to check whether my server is running or not? By using IB. Now this is my HTTP server 2 by using public IP IP4 address. Copy it and paste it in a new tab. So folks, is it my second server? This is my first server and this is my second server what I differentiated. So this is my second server. So now folks let me tell you see until and unless your first and second server are working properly you got the message like both servers are working properly then only go for creating a load balancer otherwise don't go for it. If you're not getting this message then don't go for creating a load balancer. Now I got the message. Let me go to the next step called creating load balancer. Right. The name is called CLB demo. Let me copy this. Okay. And here when you scroll down there is a option called load balancer. Create a load balancer. Classic load balancer. Let's create now. And the load balancer name is CLB demo. So now folks internet scheme how you want to like how you want to route a traffic right internet facing or internal facing. Internet facing in the sense all the traffic will be routed over the internet and that too it uses all the public IP addresses and internal in the sense it routes a traffic to the specific VPC and that to using a private IP addresses and if you create a load balancer with the specific schema after creating it's not possible to change this particular scheme now let me go with internet facing and this is very important so where your EC2 are available Well, in which availability zone you have to map that one. Now 1 A and 1 B. 1 A and 1 B. Right. Done. Now security group default is available. Select my HTTP server. Right. Then yeah here you can see as per your document if you want you can add the response time out 5 seconds interval 30. In advanc settings, response time out is 5 second and the interval is 30 seconds. Okay. Now, next you have to add the instances. Here is the option to add. That means I'm going to register my EC2 instance with load balancer. This is registration process. Which two servers HTTP server one and HTTP2 server what I created for my load balancer? Confirm it. Right. So now your two resistor are successfully added but still not resistor. Right? So keep as it is and now create a load balance. So folks now you can see my load balancer is successfully created. And if you see these steps here and that to step number four deploying classic load balancer to EC2 here a 4.2 description tab is not there. Description is changed to true. Let me show you. Click on the load balancer and description is changed to target instances. So folks here you can see in target instances still it is out of service. The health of both servers are out of service. Why? What is the reason here? The reason is also given. If your servers are unhealthy out of service you will get the reason also here. What is that? Instance registration is still in a progress. That means your EC2 instances are registering with the load balancer which taking a time and once it becomes successfully registered you are able to see in service. Both options are in service. If something went wrong unhealthy threshold value then you have to check it out your EC2 instance along with the load balancer. Now still instance registration is still in a progress. Let let's wait for 30 seconds. Let me refresh. Both are in service successfully registered. Right now let me take a DNS name. Copy the DNS name. Copy the DNS name and then go to browser. Paste it. This is my first server. Let me refresh server two. This is my second server. First second. So this is how your load balancer is distributing a load to the different servers. Okay. Let's move on to the next topic autocaling. Here we have a custom diagram. So now what is autoscaling? According to the condition defined by the users, right? EC2 autoscaling allows them to automatically add EC2 instance and remove the EC2 instance as per the demand. So why we are using this autoscaling to make sure that my application should be highly available. So as per the user definfed condition EC2 autoscaling which allows the automatically adding the EC2 and removing the EC2. Now here you can see I have uh multiple web servers right and here we have cloudatch service. Let me give the introduction to cloudatch. Cloudatch is monitoring service in AWS environment which monitor the entire environment and stores the data in terms of logs. Then ELB as you know that load balancer which distribute a load equally to the servers. Autoscaling as per the defined condition it increases and decreases the number of EC2 instance. Now here you can see if my CPU utilization 20 40 60 and this 80 that means 70 is here a threshold value. So what is the condition if CPU utilization is greater than 70%. 5 minutes 10 minutes 15 minutes 20 25 this is time now. Okay. So now folks as per the condition if CPU utilization is more than 70% for 5 minutes it should be for 5 minutes still it is not completed 5 minutes again there is a fluctuation now folks now do you think this condition is true right because now the 70% of a utilization is done for 5 minutes that is the reason it adds one EC2 instance to the autoscaling group now Right. Same scenario. Let me take for less utilization. If CPU utilization is less than 40% for 5 minutes, 1 EC2 should be removed. So now let me take a graph right and here we have time right and here let me specify this is 40%. 80 120. Right? So now this is my threshold. So now folks, do you think this condition is true? No. Do you think this condition is true? Less than 40% for 5 minutes. Do you think this condition is true? Yes, this condition is true now. This condition is true now. So when it crosses a threshold value less than 40% what we have the four instances it removes the one of the instance from the autoscaling group because as per the condition less than 40% for 5 minutes it should remove the one EC2 instance right so now folks here we have the concept of minimum desired and maximum. So now I'll specify minimum as two, desired as four, maximum as six. So always try to avoid a same values 222 444 666 avoid try to avoid that kind of a values. Now minimum number of instances means two instances. This is minimum. Desired is four. This is desired and maximum is six. This is maximum now right. So now folks when I launch any autoscaling group always it will be in a desired state 1 2 3 4 right so folks when I'm getting a huge amount of a traffic for my application what is the maximum number of EC2 I can increase here automatically AWS can increase this so maximum six now let us consider I'm not getting any traffic hardly two people are accessing this web server. So at that time minimum how much minimum two because already you have defined this always when you launch any autoscaling group it will be in a desired state when a traffic goes down minimum two and when the traffic increases maximum six. Now one condition I want to specify here always make sure that desire should be greater than or equal to minimum. Now the condition is true. Four is greater than or equal to 2. The condition is true. Now there are different types of scaling we have. Let me specify here. Then the first one is scheduled scaling then predictive scaling and then dynamic scaling. Folks, now scheduled scaling, productive, predictive scaling and dynamic scaling. What is scheduled scaling folks? Scheduled scaling is nothing but where already for certain duration I am going to get the huge amount of a traffic before only I know that. So now let me take the example. Can I consider Flipkart big billionear days, Amazon Prime sale, Black Friday sale? Right? In that we know that for certain duration I'm going to get the huge amount of a traffic that is nothing but scheduled scaling. Then what is predictive scaling folks? Predictive scaling is based on historical data. So can I consider weather forecasting is the best example for predictor scaling. One more example. Can I use machine learning algorithms? Can I use machine learning applications where I'm going to train the model based on the historical data? Now what about the dynamic scaling? So sometime the traffic is high, sometime is traffic is low. There is no any constant actual load. You can say that sometime the traffic is high, sometime the traffic is low. We are calling it as a dynamic scaling. What are the benefits I'll get if I am using autoscaling groups? Costsaving is one performance. So in terms of enhancing performance, I can say that I'm going to increase the application availability, right? Better fall tolerance, increased application availability, lower cost, right? And even folks when I'm talking about the autoscaling it monitors every instance help if something went wrong if instance is failed or unhealthy AWS automatically replace with the healthy instance that is the power of autoskll and even it balance the capacity across the availability zone. So within the single always your availability zones works within the region and that to multiple availability zone if you want. Now let me show you. Okay. Now go to autoscaling groups. If you scroll down at the left side we have the option called autoscaling groups. So now folks let me create a autoscaling group. Let me create. You can see in the dashboard itself what I explained minimum desired and maximum size when it is required it will be scaled up as needed. Now let me create a autoscaling group. So for this you want a template. So now you can see I have one document. You can see this document right. So folks let me show you this console here. we are going to configure manual and dynamic scaling right so for this if you want to launch uh one EC2 instance you want a AMI so like that here we are creating a template of that and we are launching the EC2 instance let's create a launch template so now the name is called let me give let me take the launch template name called example description blah blah blah blah blah it's up to you do you want guidelines it's up to you again. Now, which operating system do you want to use for that autoscaling group? Let me take quick start. And this is my Linux operating system, right? 6.1 AMI that 5.1 is removed. Now 6.1 is available. This is very important. You have to include your instance in a template otherwise you'll get the error. So T2 dot micro T2 dot micro right keep here don't include keep here in the template network keep as it is everything keep as it is no need to change anything click on launch template click on this now launch template is created so if you see the launch template option also the example what I created it's available for me now go to autoscaling group file so here give me the name called demo today's date is 13 demo 13 right and launch template is it the same template what I created just now called example select this so once you select the template you are able to see the configuration instance type t2 do micro everything AMI ID everything you are able to see then click on next and here you will get the options this is VPC and this particular autoscaling group should map with which availability zone? I want to select 1 A and 1 B. Now your autoscaling can do a autoscaling in 1 A and 1 B region because I have selected both availability not region both availability zones 1 A and 1 B. Next. Now here it asks do you want to attach the load balancer? If you want to attach you can select this existing load balancer you can use. Now attach the new load balancer. here itself AWS is given the option to create a new new load balancer and you can attach no load balancer right so I'll go with no load balancer capacities then click on next now configure storage sorry configure group size of scaling as per my example desired is four minimum is two and the maximum is six. Now keep as it is. Click on next. Notifications optional. Tags optional. Right. Review it. Click on create autoscaling group. When you launch autoscaling group in which state how many number of EC2 you have here? Desired is four, minimum is two, maximum six. When you launch any autoscaling group, what will be the updated capacity? Now always it will be desired state. So still it's updating. How many number of instances are available? Four at desired value. And if I show you the dashboard of EC2 also if I refresh this folks 1 2 3 4 EC2 instances which are running right now. How it is possible? A power of autoscaling. Four EC2 instances are successfully launched. Now let us consider I want to attach a autoscaling group. In some scenario autoscaling group is fine but in some scenario let us consider I want to attach a autoscaling group to main server. Let us consider the server one is main server and I want to attach this server one to autoscaling group. Select the server. Go to actions and here is the option called instance settings. Right. and attach to autoscaling group and here make sure that your autoscaling group and the main server should be in a same availability zone. If you remember my first server is 1A availability zone right. So now if you see here demo 13 1 A 1B autoscaling group is mapped right. So now this demo 13 you are attaching with your main server. Let's attach. So this is like just now I attached your autoscaling group with the main server successfully. So now folks if I show you the autoscaling group capacity. Let me refresh. Desired value and instances are changed. Why? What is the reason? Uh one main server is added to the desired value. That is nothing but a desired capacity value. How we are added to the main server? Yeah. Let me share one more thing which is important also AWS autoscaling limits. AWS is given the limit also for everything. Kota autoscaling group per regions 500 autoscaling per autoscaling group 50. everything they are given. Let's move on to the next module. So now folks in this module I'm going to discuss about the storage service a day in the life of cloud architect. So you are a cloud architect in an organization and have been asked to identify the cloud services for data intensive e-commerce company. Your task includes establishing scalable highly available secure database system to manage data effectively. implementing version control to preserve, retrieve and restore every version of the object in the database and ensuring the data encryption for high security. So using the standard SQL queries on the data and providing a option to upgrade the volume type to adjust the database performance as needed. Now to achieve this we have some few concepts in this lesson that will find the solution for given scenario. So now folks, what are the learning objective? By the end of this lesson, you will be able to create Amazon S3 bucket to store a data and objects in the cloud. Enable versioning in Amazon S3 bucket to enable data protection. Demonstrate static website web hosting using the S3 to optimize the cost and enable the scalability. Share Amazon S3 bucket between the multiple account to centralize the data storage within an organization. You can take a backup and sync the data with Amazon S3 to provide a data durability and redundancy. Transfer of files from S3 to onremises storage to perform data analysis on premises. So these are the learning objectives or you can consider outcomes. Now let me discuss about the introduction of S3. As you know that S3 is object level storage where you are going to create buckets. So what is this bucket? Bucket is like a container which holds the object and here these object might be anything whether it is image, audio, video, PDF, dog, anything. There is no restriction. You can store any kind of a data. This is unlimited storage and you can create up to 10,000 buckets in a account. No doubt these buckets are unlimited storage. You can store any kind of a data. There is no restriction. But there is a small restriction. What is that? Every what we have the objects in the bucket. It should not cross more than 5B. And when I'm talking about the object, it's a object level story. Each object contains three information. What are those? The first one is data. Then second metadata and the third key unique identifier. Right? So now folks data what exactly it contains metadata about about object that means when it was created what is the file extension what is the size of that particular object when it was created file then size everything you will get the detailed information about the data that is nothing but metadata. Now key is nothing but unique identifier. So every object in the buckets are identified uniquely. So that is the reason every object have a unique identification with a specific ID. Fine. So these all are the basics of S3 and that to object level storage. Yes simple storage service. It's a web-based storage service which is offered by AWS. So specially we are using for archiving and backuping a data online. So let me tell you folks S3 is more popular for archiving purpose and if you want to take a backup data online. So let me tell you this S3 is highly reliable service and that to where you can store retrieve and manage a large amount of a data seamlessly and that to from any time. Now what are the different like here features are available for S3 in that the first one is availability folks always your S3 data is highly available right as you know that it provided 99.99% of a assurance your data is highly available and now it ensures that your data is accessible and reliable at all the time because High availability is one of the crucial for your application that requires a continuous access along with what you have stored a data. Now scalability so as you know that scalability is one of the standard future of S3. So because of this reason it makes an ideal choice for wide range of application that to from small scale to enterprise level solution where you can store a massive data story. Now durability S3 it ensures that the data is well protected and resilient against the potential failure. It's a redundant storage across the multiple facilities and the devices that guarantees your remains highly available and secure. Now performance how we can increase the performance. There is a concept called multi-part upload. Let us consider I have the object with the 4TB. So now the 4TB object will be equally divided 1 TB 1 TB 1 TB and then finally stored in the bucket. So this process we are calling it as a multi-art upload. If the object is larger then it will be equally divided then it will be stored in S3 and this option is not available in the console. Multiart upload is not possible through the AWS console. You can go for CLI or ESDK to perform this multiart upload options. Now cost efficiency. Yes, cost efficiency. Here we have uh S3 different storage classes. So based on that you're going to pay for it. Right now security supports SSL secure socket layer data transfer which encrypts your data while it being transferred over the network. Encryption it helps to prevent the unauthorized interception and also which ensures your data remains secure during a transit between your application and S3 storage. So here S3 is responsible to perform SSL is responsible to encrypt your data when it is traveling from your application to S3 bucket that is nothing but security. Now components of S3 which is already completed. What is bucket? Buckets are containers. Keys are nothing but unique identifier, regions, a geographical location where we where we are going to create a S3 buckets. Now buckets can store text file, images, videos and even more. Any number of objects can be stored in a bucket and total bucket size is 5B. It should be object size. Any number of object can be stored in a bucket. The total object size should be 5 dB not more than that. Now here you will get the complete control. For example, let us consider Rupes has created a bucket. Now Rupesh can decide who can create a bucket. Now Siva can create a bucket. Kiran can retrieve a bucket. Then Prashant can retrieve the bucket. Suri can delete a bucket. So being a owner of this bucket, Rupesh is going to decide who can create, who can retrieve and who can delete the particular bucket. Right? So these all are the components of S3. Now the next topic is called S3 storage classes. Let's me take one example here. Right? When we are using the storage classes, as you know that S3 is unlimited storage where you can store any number of objects. If you are not selecting any of the storage class, then by default it will be stored in standard. If you are not selected any of the storage class, then by default it will be stored in S3 standard. And let me tell you this is costly also compared to other storage classes. This is costly also. But if you're not selecting any of the storage class by default it will store in S3 standard. Now folks which is let me take one example to explain the remaining storage classes. Let us consider for this Sara object I'm getting every day 10 million requests per object. Right? So always S3 standard is the best solution because it instantly stores the data and instantly retrieves the data. If I'm getting 10 million requests per day, so that means I'm going to store this object here in the standard. Now infrequent access are you going to get the same number of hits for this Sara MUI after 30 days? So let us consider after 30 days if I'm not getting that much of a hits then why should I pay more? Then it will store in infrequent access. After 30 days a object of Syrami is available in infrequent access. So now the third next option is one zone infrequent access. So what is this one zone infrequent access folks? If I talk about the S3 all the data will be replicated in three availability zone by default. Now what is one zone infrequent access? When your data is stored in one zone infrequent access the data will be available in only one single availability zone. So now the data will be available only in single availability zone. So now folks AWS itself clearly specified don't use one zone infrequent access if you have a critical data or mission critical data or any important data. Why AWS is clearly specified don't use if the data is lost it's not possible to recover it back now do you think after 90 days are you going to get the same number of hits for your Syamu? No. See might be here after 3 months you are getting 10k let me consider 1k also after 3 months sara movie will be like 1k hits. So again the cost is less but once you are stored a object in s3 glacier if you want to retrieve a object it will take time from 1 minute to 1 hour. Now after 90 days it's available in glacier. Now folks do you think are you going to get the same number of hits after 180 days here might be 100 views per day after 6 month then why you have to pay more then again this is less costly deep archive and here after 180 days that means after 6 month hardly I'm getting 100 views or 10 views sometimes so that is the reason I'll keep the object in deep archive now intelligent tiring will come into the picture based on a access pattern this sara mui object it shifts the object right so here after 90 days I'm not getting that much of a traffic intelligent tiring is responsible to shift a object from glacier to deep archive these are the frequently accessed frequently access these are infrequent access now folks in deep archive if you talk about the retrieval time it takes from 1 hour to 12 hours of a time to retrieve the object now intelligent tiring is responsible to shift a object from one storage class to another storage class based on access pattern and let me tell you folks for intelligent tiring it's like a subscription fees you have to pay monthly basis because intelligent tiring is responsible based on the access pattern after 30 days if I'm not getting that much of a responses intelligent tiring will automatically shift that object to glassier then deep archive after 6 month so now folks let me show you how to create a bucket so right now I don't have any buckets in my account let me create a bucket. So there are two options are available general purpose and directory. General purpose means all the storage classes can be utilized. Directory means only one zone one zone storage class which is specially designed for low latency use cases. Let me create a demo 13. Why I'm not able to create a bucket folks? Here you can see bucket with the same name is already exist. What exactly it means? But just now I shown you I don't have any buckets in my account. Then how is possible? A bucket name should be always unique because S3 is a global service. When you type any bucket name, it check it out in all the 38 regions whether this bucket name is already exist. Right? So demo 3 is already available. Let me make it as unique with the numerical value. Now let me create a bucket. Now I'm able to create a bucket. Right? So here I have one document for S3 naming conventions. You can see here these are the rules for general purpose bucket rules. You can see here minimum three characters 63 maximum characters all the rules they are given. Yeah. Let me take version control. Let me give one scenario. Let us consider Prashant is using one system right like he's using one laptop. Now in that he's creating one folder called ABC. Within the ABC folder we have a file called XYZ. Now folks if Prashant is trying to copy one more file called XY Z then what happens? System will warn okay show error same name file exist overrite or not allowed. So folks if you nowadays you will get one popup do you want to maintain both copies or do you want to replace with the existing one? Now version control is one of the feature in S3 bucket. This is my S3 bucket now. Right? So usually this versioning is used to keep and maintain the multiple variants of the same object and that in a same bucket. This is main object and these all are variants of that the same object. Right? If you have a single object, you can maintain the multiple variants of the same object and that two within a same bucket. Right? And even it is also used to preserve, retrieve and restore the earlier version of the object which is stored in S3 bucket. Now I have one object. I'm storing a multiple variants of the same object. Now let us consider I have deleted this object, right? And the previous version of the object becomes win object. If I deleted this object then previous version of the object becomes next object. If I delete this then previous version of the object becomes next object. So now folks each time when you upload a object S3 will automatically maintains the previous version as well. What exactly it means? It means that if you overwrite or delete a object which is versioning enabled bucket now the previous version remain accessible and not permanently lost. So you can retrieve, you can restore and even you can permanently delete a specific version of the object. And here we have three different states of versioning. In that the first one is unversioned. Then second is versioning enabled and the third one is versioning suspended. Okay. So unversioned means a bucket is available but you can't maintain the multiple variants of the same object. Versioning enabled means the bucket is created. You can create a object multiple variants. Here it's possible versioning suspended. See let us consider Bun is one of the solution architect for his organization. Right? And now BU Bun has created one S3 bucket. Barun has created one S3 bucket with versioning enabled. When he was enabled the versioning there are lot of storage it's occupied. So again you have to pay for that right. So that is the reason after analyzing two months data being a solution architect Bun is decided hey it's huge amount of a data and I'm going to pay a huge amount of for this object which is not required for me. So after that after two months analysis he decided to suspend this. What exactly it means suspend in the sense after the suspension whatever objects you are putting into the S3 bucket here it will not maintain multiple variants. Before that whatever you have the multiple variant that will be maintained but after suspension whatever you upload a object to this bucket all the objects will not maintain a multiple variants right that is nothing but suspension. So now let me show you the same thing in the console. See here we have two buckets like two different types as I discussed. So now let me give the name called demo. Demo of today's date is 14. Let me make this bucket as unique otherwise it's not possible to create a bucket. Can you see this? There is a option called bucket versioning. Even from AWS uh best practice you can say that one of the best practice always enable bucket versioning. Right. So folks let me tell you even sometimes what I heard you will get the question based on the bucket versioning in AWS solution architect associate examination. What is the main use case of bucket versioning? So to avoid the accidental deletion, we have a versioning concept. So here we have disable and enable option. Let me create a bucket. All right. Now let me upload a object into this bucket. Now what I created just now. So here is the upload option. Just click on add files. Now you can see folks I have one launch template txt. Let me upload one more time. Done. Okay. Now again. So folks, now this is my bucket destination bucket. How many times I uploaded the particular file now? Three times. Then I as I can see only one document I have here. So here folks there is a option called show versions. So now you can see one two three a three different time. what I uploaded the same file with the different version ID. So as I clearly specified in the previous session also every object in the bucket are identified by the version ID. So if I delete let us consider let us consider I'll delete this object. Let me delete this. Right? So here you have to type delete. So once I delete the object, the object will be marked as delete marker and it will be available in versioning. Let me show you. Now no object because the object is successfully deleted from a from the bucket. Now here it's available in versioning with the delete marker. If I delete this permanently, the previous version of the object becomes the main object. Now let me delete permanently. You can see here the permanently delete option I have. So folks let me tell you once you permanently delete the object what you have deleted it's not possible to retrieve it back. So now the object is successfully deleted. If you go to the bucket folks in the bucket I have the previous version of the same object. Once I deleted successfully the object uh permanently deleted. Now the previous version of the object becomes my main object. And here again the versions are available. So these are the different versions even. Yeah, let me show you where exactly you will get the suspension option. Go to properties encryption. Yeah, here itself bucket versioning enable suspend. Even after the creation of uh bucket after the creation of a bucket also if you want to suspend after suspension no object will be considered as versioning. Now folks there is a concept called cross region replication CRR. So you can see here first bucket and this is second bucket. So now folks cross region replication is one of the bucket level feature enables the automatic and asynchronous copying of a object across the bucket in a different or a same AWS regions. So now this cross region replication is a feature which is specially designed to enhance the data durability not only durability even availability by maintaining redundant copies of your object in the multiple region. If you are maintaining the same data in the multiple region then when should I use this? What are the use cases? So folks can I use for disaster recovery? If this particular bucket is failed this bucket now disaster is occurred at this bucket now you can rely on the replicated data in the destination bucket for a data recovery right and here folks when I'm talking about the asynchronous process it means that the object replication occurs automatically in the background without affecting the performance or a latency of your application. So whenever a synchron comes a come a synchronous copying of a object that means automatically in the background without affecting the performance it perform the task right and let me tell you folks even if you want to use uh MFA for that like a multiffactor authentication for cross region replication that is also possible right you can use for disaster recovery even you can use for even uh region outage at that time you can use this cross region replication Now let me take you to the console. So now shall I consider this as a source because already we are created this bucket. So now let me create a destination. So let me make it as unique. Okay. Now keep as it is bucket versioning enabled. Yeah one thing is if you want to do the cross region replication make sure that both bucket should be versioning enabled. This is the condition. Now let me create a bucket. All right. So now my source and destination demo is source. Destination is a destination bucket what I created. Now go to source. So let me show you one more thing folks. I don't have any objects in my bucket. In destination I don't have any objects in my bucket. But same thing if you see source here I have some objects along with the versions. Right now go to source and here folks there is a option called management. Click on management. Now here you can see replication rule. So create application rule. Now put the name demo 14 now. So it should be status always enabled. Right? Rule will be enabled or disabled. Now source bucket. This is my source bucket. Right? And do you want to go for more specific for the objects? You can apply the prefix for the filter. Right? Now I don't want to go for it. I want to apply for all the objects in the bucket entire bucket. Right? So now you have the option choose bucket in the same account. If it is same account, you can directly choose the bucket from here. If you want to go with another account, what is required folks? Let us consider I want to do the cross region replication with different account. Let us consider this account is belongs to Prem and the another account is belongs to Shubam at that time what is required if I want to communicate with you what is required let us consider Ru is available in Mumbai I am available in Bangalore if I want to communicate so what I'm using first thing you require the account ID of the next person and the bucket name you can select so now choose a bucket in the this account right Now I'm using from this account. Let's select destination is a bucket where I'm going to replicate my data. Right? Choose path. After selecting the path here, see permission to access the specified resources. The role should be created. And let me tell you no need to think about this. Click on create new role. AWS will take care about this. Then it's additional features. If you want replication RTC, replication matrix. So RTC is nothing but within a 15 minutes the object will be replicated in the destination bucket right there is a spe special feature and these all are the special feature replication marker delete marker replication these all are the special features it's up to you being a solution architect whether should I use or not it's up to you now click on save okay so now there is a popup do you want to replicate all the objects or do not replicate the existing object that means now it's asking Do you want to replicate the all the object which is available in source bucket to destination? Yes, I want to replicate. Submit it. Okay. Now, are you people familiar with the batch operation? Okay. Let me explain. Batch processing is nothing but a bulk number of processes are going to be executed at specific time. So now here it starts copying a object from source to destination. And here you will get the complete report. That means whether any task failed. Now do you want the report only the failed task or all task? I want all the task whether it is completed or failed. Everything should be recorded. And where you want to maintain the report? I want to maintain the report in the same account. And that too whether do you want to go with source or destination. So I want to store the report in destination. And again permission again I am new role AWS will take care. We don't have to do anything for this batch processing. Let's click on save. So now folks, once I click on save. Yes, you can see successfully created the job ID. You can see here just now I create what I created status is new replication operation is replication. See total number of objects. Once it starts copying of a object from source to destination you are able to see the how many number of objects are copied and how much it is completed and how much it is fed if something went wrong why it is wrong everything you'll get the detailed information and what is the percentage it is fed right now this is all about the batch processing like uh how your cross region replication is doing from source to destination let's move on to the next topic now let's move on to to the next topic called S3 life cycle management. In simple terms, you can say that it's a manual process. If you remember in the previous session, I was discussed about the S3 storage classes where intelligent hiring is responsible to shift object from one storage class to another storage class based on access pattern. Now here we have a different storage classes. Right? Let us consider this is standard. In S3 life cycle management you are going to manually specify the number of days. Here in standard I want to maintain the object for 30 days. Here in infrequent I want to maintain for 45 days. In archiving I want to maintain for 90 days. In deep archive I want to maintain for 180 days. What I'm doing now? I am specifying my object should be available in this storage class for 30 days. After that I'll shift to the infrequent axis. After that 46th day I'll shift to the glacier. After this I'm going to shift to the deeper time. Why I'm doing this? So to save the cost because standard is costly. After 35 days I want to shift to 45 days a next storage. After 90 a low cost 180 to low cost. Right? As I discussed with the example when I'm getting a huge traffic for the Titanic object which is available in deep archive based on the access pattern it shift to the standard. Now in this life cycle management it's purely manual process right the major difference between your S3 storage classes and your uh manual process is here we don't have any reverse gear that means if for this object even I'm getting a huge traffic it's not possible to shift this object to previous storage class what is the reason because already you have defined the number of days and even you will get the option After how many days you want to delete the object? If you put 178, it will not accept. Why? Because up to 180 days the object will be available in storage. So you will get the message it should be greater than 180. You can put 181 anything. Then after certain duration the object will be deleted. You can't use 160 because the object is available up to 180 days in a deep archive. Then how you can delete that object? After 180 only you can specify at the 181 day the object will be removed. Now so folks this S3 life cycle management actually we are doing this operation to manage our objects in a cost effective manner throughout the entire life cycle to save the cost but everything is manual and even let me tell you folks the intelligent tiring is also considered as one of the storage class. So here we have a two types of actions. What are those? The first one is first transition action and the second one is expiration action. So now what is transition action folks? Now this particular actions it deals with moving a object from one storage class to another storage class at specific time time what you're defining based on that the object will be shifted. So no doubt which helps to optimize the cost. Now expiration action the name itself indicates expiry. So now this particular actions it delete the object after certain period and even it ensured that the data should not store the longer than necessary time longer than necessary time. Now this S3 life cycle management is a XML file which contains the information like rules and predefined actions which can be applicable to S3 objects and the rules entire lifetime. So now this S3 life cycle management you can access by using AWS console CLI then SDK these are the options when you apply any life cycle configuration rule to the bucket by storing the life cycle roots it will applicable to the sub resources which are attached to the buckets right now same thing let me show you in the console okay let me take this only source demo kit Go to management and here is the option called life cycle rules. Create a life cycle rule. Let me put the name called demo 14 for rule name. And do you want to apply a specific objects? No, I want to apply for all the objects. Right? Acknowledge. So these are the life cycle rule action. So now you can see folks the two important actions in that the transition and expiry. Right? If you scroll down I don't have any option. When you select this transition current version of the object it consider transition non-current of the non-current version of the object between storage classes that means this will be versioning object versioned object that will be considered right so now if I selected transition current version of the object acknowledge it you can add here and now I don't have any expiry option let me take the expiry current version of the object now here I'm able to see the expiry of the object also let me Add some values. Standard. Let me add 30 days. Next folks, you can see here intelligent hiring as a storage one zone 90. Next. Flexible retrieval. Let me take it as 150. Now deep. Let me take 365. All right. So now folks if I provide delete after object creation that means you can delete the object. If I'll give the value called 333 also you will get the message it should be greater than 365. Now if I use 366 then it will accept. Same thing here if you change this to 210. So now let me consider let me give the 279. Here you'll get the message the value should greater than 280. Now this is all about the manual process S3 life cycle management. Let's move on to the next topic called access control. Access control what is access control as per your knowledge. How you will define this access control? Let me take uh more simple terms. Can I call it as a basic readr operations or readwrite permissions? Access control is nothing but granting the basic readr permissions to other AWS accounts. By default, the account that owns object can access and grant the other user to access through the ACL. Right? So by default all the objects belongs to the owner of the object. If you want to provide uh access to another user at that time you can use AC L right. Let us consider here we have a one bucket and this is 1 2 3 and the owner of bucket but two right. So now there is another account called 456 and here the user is GH right and now you want to provide a cross account access. There are multiple options we have by using the ACL also you can provide access to other accounts. There are multiple options we have. Now let me take uh three different scenario. The first is if you want to change the default behavior of this particular bucket then you have to change the object ownership. If you disable the ACL that means all the objects of this bucket will belongs to only bucket owner. And the third if I want to provide access control to other user can I use IM policies ACL IM role and there is something called SCP. Then we have service control policy. Let me explain what is service control policy. Usually service control policy will be used in multi- account environment and this level we are calling it as OO level. This is organization unit. If you want to apply a policy at OO level then we have a concept called service control policy SCP always SCPs are used in multi- account environment with multi like AWS organization service right so here SCP will be applied why only the childs which are inherited to this parent will be shared the properties of this particular node that is the power of SCP if I if you want to share the bucket between the multiple accounts You can use IM policies, right? Resource-based policies, then ACL, cross account access. If I want to go for cross account access, you can go with IM roles and even more options. As I discussed even in the previous topic also there are different types of replications. We have cross region replication, same region replication and the one more is replication with the time control. This is one of the feature within a 15 minutes it copy all the objects object from the source to destination. Now let me show you about the ACL. When you click on create bucket here is the option here we have object ownership. This is recommended disable means all the object of that particular bucket will be owned by the only bucket owner. If you want to access to this bucket and objects specified using the policies. So when you enable this objects in this bucket owned by other account. So using ACL you can provide a permission to access with the other customer. So ACL is one of the method you can use IM policies, IM roles, bucket policies and this ACL also when you disable all the buckets are secure. All the objects within the bucket are secure because only owner can access. When you enable it's up to you how you are going to provide a access to other customer and if you want to change the behavior of this bucket always you have to change the bucket ownership then only it's possible this is all about the ACL now so now folks let me take you to the next topic called storage gateway so before going to storage gateway what is gateway folks let me design a single single routes, entry and exit point. The next entry point. Okay. See just now taking one analogy here. This is one house with this boundary with compound and gate. So can I call this gateway single entry single exit point. Okay. Now this is one house along with the boundary and a gate. So now if I want to connect from this promises to so-called society whether it is to entry or exit. So this envir environment is totally different. This environment is totally different. Now same thing this is my onremises environment and here we have storage gateway and this is my AWS environment. This is my storage gateway. In simple terms, if I want to extend the capability of onromises data center to AWS environment at that time, I'm using storage gateway. So now see here I taken the name called storage gateway. Let us consider if I have any type of a gateway whether it is storage gateway also how I can improve the performance of the storage gateway. What are the factors I can consider here? Can add the additional CPU resources to the gateway host. Even you can add the additional CPU resources to the application environment if you want to perform at this level of a readr permission. So what kind of a storage I can use here which provides the highest IOPS. So here you can use the SSD a high performance disk. You can add the resources to the gateway host. You can add the resources to the uh application host and even you can increase the bandwidth between your application and gateway. These are the things when it comes. So now you can see here this is my onremises environment. Now you can see there is a diagram. This is my onremises environment right and this is my AWS environment. See in simple terms why we are using storage gateway as you can see if I want to extend the capability of my onromises data centers to AWS at that time I'm using storage gateway now logically how it works here you can see in on premises we have file gateway volume gateway tape gateway right so using the different protocols what we are using so storage gateway in between we are using between on-remises and AWS environment If I want to connect from onremises to AWS environment here we are using a strategy called direct connect there are different options are available you can use side to side connectivity you can use direct connect you can use VPN connection there are multiple options are available so being a solution architect you know that which particular option should be selected in which particular situation let us consider Arun is one of the solution architect for ABC organization. Now Arun is one of the solution architect for ABC organization. So now storage gateway which serves as a crucial component for this ABC organization and now they are seeking to build a hybrid cloud storage solution. This ABC organization they expecting a hybrid cloud storage solution. How? by seamlessly integrating your onremises environment with a cloud storage. Right? So now this ABC organization can enhance the accessibility, scalability and cost efficiency where you will get the vast array of cloud services where a storage services different storage classes backup archiving FSX right even automated backup there are different options are available right so when I'm talking about a collection a hybrid solution it is a collection of hybrid cloud storage service that bridge the gap between your onremises data centers and virtually limitless cloud storage which is available on AWS platform. Now for ABC organization it empowers to use a cloud storage seamlessly while maintaining hybrid architecture. hybrid in the sense it combines the both benefits of onremises infrastructure as well as cloud services. Again I'm repeating it combines the benefits of both on premises infrastructure as well as AWS environment. So this is the power of storage gateways. Now let me take you to the next option called encryption. So now folks encryption. So what is encryption folks? plain text to cipher text, encoding to decoding, readable form to non-readable form. Here we have a different options. There are different encryption types. If you are not selecting any of the encryption type, by default it will be considered as SS3. In every operation, we are not selecting any of the options. So by default, it will be encrypted by using SS3. And let me tell you this is totally free service. And here here it uses the AES advanced encryption standard 256 algorithm which is one of the strongest blocks refer to encrypt your data. So there is no any additional charge. It's a free of cost. Now the second option is server side encryption with KMS. When you select this option it asks you do you want to choose from the KMS keys. Always there is a default key available for you. If you want you can create default one you can use default one. Now if you want to enter the ARN create a key copy the ARN that is also fine. Now I want to create a entire new key that is also possible. And folks let me tell you this is chargeable. KMS is key management services chargeable. You have to pay for it. Now how to create a KMS key? Let me click on that. Here you we have option symmetric and asymmetric. Symmetric means what? Single key will be used for encryption and decryption. But here a symmetric means public and private key will be used in AWS environment. A R and Amazon resource name is the unique identification for every service like ES3, KMS keys, EC2 like that for every services even IM user, IM roles for everything we have AR. Now symmetric asymmetric single key and public private key for what purpose you are using for encryption and decryption purpose. Click on next. So provide the alias name. Display the name of the key. Let me take demo 14. Same. Okay. Description is optional. Leave it. Next. So what are the key administrative permissions? This is also optional. Key administration permission to whom you want to give. Let me take myself. 328 is the username. Select the user. Click on next. What about the usage permission? Same usage permission. I'll provide to myself for demo. Sorry, this is the key policy what we have. Automatically it will be generated. Then click on next. Now you have successfully created a keys key demo 14. So folks, this key is avail. And now if you want to use this key now it's available. Is it the key what I created just now in front of you people? Select the key and create a bucket. Bucket name demo. Make it as unique. Make it as unique. Then create a bucket. Now the bucket creation is successfully done. Now is it possible to modify the encryption type after the creation of a bucket? Then S 7373 and here we have properties right default encryption you can change if you want to change from KMS to SS3 you can go for this okay there is one more type we have dual layer server side encryption that means at the board layer encryption will be done and this is like you are going to pay more for this if you want more advanced security and more features at that time usually we go for this okay Now let me show you this key. Let us consider I'm not using this key for longer duration. So first if you want to delete directly it's not possible. First you have to disable this. Even after disable also you can't delete directly. You can make schedule key deletion directly which is not possible. And here you can specify the duration from 7 to 30 days. So now I'm specifying 30 days. After 30 days only this key will be deleted. confirm it. Now once I confirm after that only the key will be deleted. That means after 30 days your key will be deleted. Let us consider no again I'm going to use the same key. In that situation you can cancel the key deletion. That is also fine. Then you can use the same key if you want. If you want you can enable again you can use the same key as per your requirement. Let's move on to the next storage type called Amazon FSX where FSX is also one of the family offer service that makes easy to launch, run and scale. a shared storage which is powered by a popular commercial opensource file systems. So this FSX supports a two different popular commercial file system. The first one is FSX for Windows file server and the next one is Luster. Amazon FSX for Luster. Let me focus on Windows file server now. Okay. Then we'll go for luster. Windows file server. FSX for Windows file server is managed by AWS. And let me tell you this is specially designed to provide a fully native Windows file system capabilities. So, Windows file system capabilities that two in AWS cloud and now this Windows file server it allows the seamless integration with AWS environment. So, because of this reason it makes an excellent choice for Windows-based application as well as a Windowsbased workload. Now and folks let me tell you this Windows file server as you know that it is designed to provide the fully native Windows file system capability and even this is specially designed to scale as per the growing demands of your application. Now user can easily adjust the capacity and the performance of their file system to meet the change requirement. So now folks this scalability part is very essential for the workloads that experience fluctuating demands. Fluctuating means sometime it's high, sometime it's low. So at that time this is very important. Now FSX for Windows server can be accessed by using the protocol called SMV server message block protocol. Right? And apart from that it allows a seamless integration with Windowsbased application and even it makes an easy to move uh existing file workload to AWS environment that too without any modification that without any modification right now apart from that this is specially designed to provide advanced administrative features like a simplifying data management and even user access. So now even a kota a maximum limit for the users and user can restore the enhanced usability and system will provide a overall productivity of every services. Apart from this there is one more important feature. So now this FSX is integrated with Microsoft Active Directory which allows your organization to manage the existing management of a infrastructure and even this integration will streamline the process a user authentication access control providing a more advanced features to the end users. Right? So now these are the important points about the FSX for Windows. Now first okay pie first point is Windows file servers are specially designed to provide a fully native windows file system capability in the AWS cloud. Now if I want to deal with the Windows workloads so now it's a native file system capability which is provided in the AWS environment. Now what are the benefits I'll get? The first one is it builds on a Windows server. Now this is simple and manageable and folks SMB protocol if I compare with the other protocols SMB is the lowest cost which provides flexible performance secure and compliant and even broadly accessible. So these are the benefits for FSX for Windows. Luster is also one of the file system here which have the ability to deliver a high-speed processing. What is that high speeded processing? Now folks, let me tell you the data throughput which exceeds more than 100 GB per second. So now this throughput is one of the essential for a performance intensive application that required some realtime analysis and quick data access. So because of this performance this is widely adopted by the HPC community. So luster file system is adopted by HPC community and to its scalability because of the scalability and performance characteristics. Right? So when you're using this leure file system, it brings the benefit of performance capability to AWS environment. Because of that reason it provides the reliable and fully managed solution to the performance critical workload. Right? So now no doubt Luster is designed to handle a high performance computing workload. What type of a workload? What are the use cases? Can I consider data analytics as one of the HPC workload? High performance computing workload folks. Can I consider scientific simulation? Consider the machine learning also one of the high performance computing workload. Data analytics, scientific simulation, machine learning where you are going to train a models. Right? No doubt these provide some exceptional performance and because of that reason we are using a luster file system which are valuable assets for your organization for fast data processing. Now luster is integrated with one more service. This is my luster and this is my S3. Now integration with Amazon S3 it opens the new possibility for a data access and collaboration. So you can access a large scale data set which is stored in this S3 using the luster file system. Right? Even it enables a efficient data sharing and analysis. So luster file system is given a two deployment option in that the first one is scratch and this one is persistent. Let me give the hint what exactly it is. Scratch is like instance store. Persistent is EBS. Scratch file system means it stores a temporary data and here the data can be stored up to 14 days not more than that persistence. So now persistent it include the durability throughout the automatic backups and even which is suitable for long-term storage right so here this particular option is preferred to store a critical data that require some persistent storage reliable storage at that time you can go with this option now if I talk about the benefits so folks high performance computing scalability is also one of the part right Then next let me take reliability also. Next seamless seamless access to yes3 scratch and persistent multiple deployment option. So these are the benefits of luster file system. If we talk about the fsx for windows as well as luster. Yes, Pranit because it provides the up to 100 GB pbps at throughput. Luster is in which operating system by default? Luster you're talking about the luster in which operating system by default? See Arun Luster itself a Linux based parallel file system. Luster itself a Linux based parallel file system. uh if I talk about the luster file system drawbacks leer can be only used for Linux file system. So now here we have a two services the first one is glue and the second one is Athena. Glue is serverless data integration service. Serverless means no need to think about provisioning, updating, patching, everything will be taken care by AWS. Glue is serverless integration service that helps you for ETL data that to extract, transform and loading from the various sources into the centralized data store. Right? Centralized data store. So usually these ETLs are used for preparing a data for analytics purpose extraction transformation or you can say extracting transforming and loading. So you can get the data from the various sources that to for a centralized data store. So what are the features of this glue service? Here we have a concept of data catalog. Then data catalog. Data catalog is used to store a metadata about the data set. Now ETL jobs where you are going to perform extract, transform load. How? By using Python script to transfer your transfer your data. And here we have one more feature called crawlers. Crawlers are used to automatically detect the schema and update the catalog. Schema is nothing but the systematic representation of a data. So schema is nothing but systematic representation of a data. Now crawler will automatically detect the schema and update the catalog as per the data set metadata will be updated. And the fourth feature is serverless serverless no need to think about provisioning updating patching everything will be taken care by AWS. So this is for glue service which is specially designed for ETL jobs. Now Athena Athena is also one of the service in AWS. Athena is also serverless service which allows you to run a SQL queries directly on stored data which is available in S3. Again a serverless. If I talk about the features, Athena is also serverless. No need to manage your infrastructure and it works with the S3 and here it support the ESQL. No need for database engine directly. You can perform a queries by using SQL services. Now if I talk about the Athena. Okay. Now if I take the example of Athena. Now let us consider prianit is data analysis and want to analyze the customer transaction log which is available in S3 bucket. Now first thing you have to store all the transaction into S3 bucket. Now if I want to create a data catalog glue service the first thing is the first step is done. Now all the transaction will be stored in S3 bucket. And now in the second step I am going to use the glue service to create a data catalog. And now after creating a catalog I am going to run the SQL queries using the Athena service to analyze the data without setting up of a database. This is all about the Athena service. Now let's move on to the next module that is networking. Here the topics are VPC, networking and content delivery. As you know that in every module we'll get a scenario. A day in the life of cloud architect. So being a cloud architect, what is your responsibility? Cloud architect in an organization and has been asked to address security concerns about moving the company infrastructure to the AWS cloud. The company has outlined a specific requirements. They seek an entity that can attach to any AWS resources defining its access permissions. Instead of distributing long-term credentials like username, password or access keys, the company requires a solution offering temporary rights to application when they interacting with AWS resources. They aim to manage governance, compliance, operational audits and risk assessment within the AWS accounts. The security and compliance of application on AWS should align with the company's standards. So now John's responsibility include setting up an AWS account and utilizing the AWS command line interface to engage with AWS services and resources. He must also master using the AWS identity and access management to ensure the secure access to AWS resources. To achieve this, he will learn a few concepts in this lesson that will help you to find the solution for given scenario. Now, what are the learning objectives? By the end of this lesson, you will be able to configure IM and its policy to ensure secure access management. Create and configure CloudFront distribution to distribute a content globally. Create and configure VPC endpoint to privately connect AWS services without public internet exposure. Implement a range of routing methods to manage a network traffic efficiently. So folks, these are the objectives or you can call it as outcomes. Once you complete the module, you are able to answer the questions based on these topics. What is networking? Networking is nothing but establishing a connection between two or more devices to share the resources. Simple terms here you can see first is VPC internet gateway knackl network access control list public subnet route table security group EC2 VPC virtual private cloud. So virtual private cloud is a isolated area where you can deploy your AWS resources where you can deploy your AWS resources like in the previous session you are created one EC2 right you are deployed in this VPC you are created one load balancer you have deployed in this VPC because it's a isolated area no one can enter without your permission let us consider this is Gagandep VPC now Gagandep is the owner without Gagandep permission No one can enter. This is Diwak VPC. This is Santo VPC. This is Shivam VPC. Now without Dagandep, without Diwaker, without Santosh, without Shivam, no one can enter this environment. So it's a service which isolate the resources. Now Diwaker is going to use EC2, S3 or we have RDS relational database service. Then we have KMS. Everything is going to deploy all the he services is going to deploy in this VPC because it's a isolated area. No one can enter without your permission. Now by default per region you can create five VPCs not more than that. If you want more then you have to contact AWS support team if you want to increase this kota. Now now let me take one simple example here. Okay let me take plot. Now this is 6040 site. Okay, this is my VPC. If you see here in this diagram, first VPC just now what we are completed. Now we have subnet. What is subnet? Now let me discuss. Subnet is nothing but range of IP addresses. That means within a single VPC how many IP addresses I can utilize? That is nothing but subnet. And this subnet is divided into two types. The first one is public subnet and the second one is private subnet. Okay, this is public subnet. The range of IP addresses that customer can interact. Private subnet the range of IP addresses within VPC they can interact. Now let me take this 60/40 site. Now here I have one gate and this is my sit out. I'm talking about the 6040 site, right? And this is hall, dining room and all. This is public area now and this is private area. of your house. Right? Now here we have kitchen then bathroom, washroom and a bedroom everything. Now folks let us consider a new person arrived to the home. This new person can access the public area. Now this new person want to access the private area of your house then he should take a permission from a family member. Then only he's allowed he or she is allowed. Now same thing let me take with VPC. This is public subnet and this is private subnet. Let us consider I have flipkart website. So for this flipkart website everyone is able