Elastic Stack Essentials
BigData Training Architect II in Content
If you are new to the Elastic Stack and are looking for a beginner-level introduction to its core services, then this is the course for you! You will get to follow along as we create a log and system resource aggregation pipeline using Beats, Elasticsearch, and Kibana. Ultimately, you will get to ingest your system log and telemetry data to view and analyze it all in Kibana using pre-built dashboards generated by Beat modules.
Welcome to the Elastic Stack Essentials course! Let's talk about who this course is for, what you should know beforehand, and ultimately what this course entails.
About the Training Architect
Get to know a little bit about Myles Young, the Training Architect for this course.
Elastic Stack Overview
Before we jump in and get hands-on with the Elastic Stack, we first need to quickly go over each of its components, as well as some basic terminology and concepts. So let's take a quick look at the Elastic Stack services to better understand what each service's role is and how it works.
Deploying and Configuring the Elastic Stack
Deploying a Multi-Node Elasticsearch Cluster
Let's get hands-on in deploying a multi-node Elasticsearch cluster. This will be the start of our log and system resource aggregation pipeline. Follow along using Cloud Playground as we:Import the Elastic GPG key Download and install Elasticsearch from an RPM Configure Elasticsearch to form a cluster Configure Elasticsearch to listen on multiple addresses Start and test an Elasticsearch cluster
Securing an Elasticsearch Cluster
Data security should always be a top priority when designing and building any big data technology. In this lesson, we go over how to minimally secure an Elasticsearch cluster to ensure the internet does not have free reign over our data. Follow along using the Cloud Playground as we:Generate a cluster certificate Configure the Elasticsearch Security plugin Enable transport network encryption Enable user authentication Set built-in user passwords Interact with a secure Elasticsearch cluster
Installing and Connecting Kibana to an Elasticsearch Cluster
Now that we have a secured Elasticsearch cluster, let's deploy a Kibana instance to connect to it, so we can use it later as a window into our data and cluster services. Follow along using the Cloud Playground as we:Download and deploy Kibana Configure Kibana to listen on a specific port and address Configure Kibana to connect to a secured Elasticsearch cluster Start and navigate to Kibana
Collecting and Shipping Logs with Filebeat
With our cluster taking shape, let's start collecting and shipping data to it. We will use the
system module in Filebeat to collect, ship, parse, and visualize system logs from each of our playground servers. Follow along using the Cloud Playground as we:Download and deploy Filebeat
Configure Filebeat to connect to Kibana
Configure Filebeat to output to Elasticsearch
Set up Filebeat modules
Collecting and Shipping System Telemetry with Metricbeat
Adding to the data in our cluster, let's deploy a Metricbeat client so we can collect and analyze the system resource utilization telemetry of our cluster nodes. Follow along with the Cloud Playground as we:Download and deploy Metricbeat Configure Metricbeat to connect to Kibana Configure Metricbeat to output to Elasticsearch Configure Metricbeat modules Set up Metricbeat modules Start Metricbeat
Analyzing Data with Kibana
Now that we finally have our cluster set up and collecting data about our nodes, we get to use Kibana to analyze and gain insights into our system logs and resource utilization metrics. Follow along using the Cloud Playground as we:Connect to Kibana from our local browsers Use the Metricbeat System dashboards to analyze our system resource usage Use the Filebeat System dashboards to analyze our system log events
Now that you have a basic understanding of the Elastic Stack, let's build on that knowledge! Here, we go over some other courses you may be interested in taking next.
Take this course and learn a new skill today.
Transform your learning with our all access plan.Start 7-Day Free Trial