6 min readJul 12, 2020

Given by Vimal Daga Sir [INSTRUCTOR]

Under the community of LINUXWORLD INFORMATICS
PVT LMT .

LW COMMUNITY :

Before precede to task I want to share that LW community is doing great work to make the student future ready . They lauch the program/classes in very minimum price so everyone can participate and instructor vimal daga sir is world record holder so they teach from bottom level upto high level and cover extra topic from their side .

>> In This Project I had run ELK on top of EKS

To Understand the project having little bit of knowledge of
1. ELK STACK:

The ELK Stack is a collection of three open-source products — Elasticsearch, Logstash, and Kibana. They are all developed, managed ,and maintained by the company Elastic.

E stands for ElasticSearch: used for storing logs
L stands for LogStash : used for both shipping as well as processing and storing logs
K stands for Kibana: is a visutalization tool (a web interface).

2. YAML CODE :

YAML is a human-readable data-serialization language. It is commonly used for configuration files and in applications where data is being stored or transmitted. YAML targets many of the same communications applications as Extensible Markup Language but has a minimal syntax which intentionally differs from SGML.

3. AWS:

Amazon Web Services (AWS) is a subsidiary of Amazon that provides on-demand cloud computing platforms and APIs to individuals, companies, and governments, on a metered pay-as-you-go basis. In aggregate, these cloud computing web services provide a set of primitive abstract technical infrastructure and distributed computing building blocks and tools. One of these services is Amazon Elastic Compute Cloud (EC2), which allows users to have at their disposal a virtual cluster of computers, available all the time, through the Internet. AWS’s version of virtual computers emulates most of the attributes of a real computer, including hardware central processing units (CPUs) and graphics processing units (GPUs) for processing; local/RAM memory; hard-disk/SSD storage; a choice of operating systems; networking; and pre-loaded application software such as web servers, databases, and customer relationship management.

3. Kubernetes:

Kubernetes is an open-source container-orchestration system for automating computer application deployment, scaling, and management. It was originally designed by Google and is now maintained by the Cloud Native Computing Foundation.

4. EKSCTL:

This getting started guide helps you to install all of the required resources to get started with Amazon EKS using eksctl, a simple command line utility for creating and managing Kubernetes clusters on Amazon EKS. At the end of this tutorial, you will have a running Amazon EKS cluster with a managed node group, and the kubectl command line utility will be configured to use your new cluster. eksctl automatically creates several AWS resources for you.

Here In AWS create IAM user having administrator power and configure in CLI with same IAM user.

Then come to project we need to follow steps as ::

STEP-1: Create Planning

> here in first block we lauch the cluster yaml file .
But in that we put 8GIB RAM because ELK need around 4GIB ram and 4 VCPU . See in aws volume type (I use t2.medium)

> Second we create fargate cluster to create blackbox that will automatically create resources as we needed.

> then using single namespace create the pod of all three ELK.

> lastly using Helm we upload the images of ELK on top of EKS.

STEP-2 :
We create yaml file for cluster(cluster-config) and fargate-cluster as:

STEP-3 :
Then after creating we have to run the file one by one we run mycluster.yml file first as :

then after completing this we update the kubeconfig view to change to our cluster and then run farcluster.yml file as :

STEP-4 :
Then after this we creating we initialize the helm but don’t forget to run thiller
in current namespace i.e. kube-system as :

STEP-5 :
Then start tiller in service account because helm need in behind tiller as :

STEP-6 :
# Then launch elastic-stack( launch first because logstash and kibana internal file ping to elastic-stack) using helm (search on helm hub chart of elastic stack copy code to add on repo list ) as :