Centralized Logging in the Cloud with Elasticsearch and Kibana you own this product

prerequisites
intermediate Terraform • intermediate Bash scripting • intermediate AWS Cloud
skills learned
create and maintain virtual infrastructures • work with application logs from Elasticsearch and Fluentd
Christopher Love, Eugen Cocalea
5 weeks · 7-10 hours per week · INTERMEDIATE
Included with a Manning Online subscription
try now

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

I found it very exciting, albeit very challenging... I've learned a lot and have ideas on how to use what I have learned.

Christian Kreutzer-Beck
Look inside

Accurate and reliable logging is the cornerstone of good DevOps, allowing developers to easily spot problems and speed up their development processes. In this liveProject, you’ll learn to deliver cloud-based logging by stepping into the role of an SRE for an online retail startup.


You’ll go hands-on to deliver a cost-effective solution that gathers site logs in a central place in real time, then allows users to interact with those logs through an application interface. Your challenges include building your application infrastructure, creating the configuration to send logs to AWS Elasticsearch, and deploying an Elasticsearch cluster on EC2 instances. By the time you’ve completed your project, you’ll be able to use AWS, Terraform, and more to deliver log access and availability—an essential part of any IT infrastructure.


You’ll be able to complete this liveProject with just the resources provided by the free tier of AWS.

This project is designed for learning purposes and is not a complete, production-ready application or solution.

book and video resources

When you start your liveProject, you get full access to the following books and videos for 90 days.

Very interesting project; many different technologies and experience gained.

Kosmas Chatzimichalis

project authors

Eugen Cocalea
Eugen Cocalea is a veteran systems administrator with over 20 years of experience in the industry. Eugen has a special interest in Linux/Unix and DevOps practices and processes, with a working knowledge of AWS/GCP/Azure, Terraform, Puppet/Chef/Ansible, Groovy, CI/CD tools and scripting, and more. He works as a solutions architect at OpsGuru.
Christopher Love
Chris Love is a Google Cloud Certified Hybrid Multi-Cloud Fellow and a co-founder of Lionkube. He is the author of the Manning publication Core Kubernetes. Chris has over 25 years of software and IT engineering experience with companies including Google, Oracle, VMWare, Cisco, Johnson & Johnson, and others. As a thought leader within Kubernetes and the DevOps community, Chris has contributed to many open-source projects including Kubernetes, kops (former AWS SIG lead), Bazel (contributed to Kubernetes rules), and Terraform (an early contributor to the VMware plugin). His professional interests include IT culture transformation, containerization technologies, automated testing frameworks and practices, Kubernetes, Go, and other programming languages. Chris also enjoys speaking around the world about DevOps, Kubernetes, and technology, as well as mentoring people in the IT and software industry.

prerequisites

This liveProject is for intermediate SREs who have experience with cloud providers and basic scripting. To begin this liveProject you should be familiar with the following:


TOOLS
  • Intermediate Terraform
  • Intermediate Bash scripting
  • Intermediate AWS Cloud
  • Basic Docker
  • Basic Elastic
TECHNIQUES
  • Infrastructure as code
  • Infrastructure deployment

you will learn

In this liveProject, you’ll learn to use Terraform to create and maintain virtual infrastructures, package applications as containers, and work with application logs from Elasticsearch and Fluentd.


  • Write code that will create EC2 machines to support running company applications
  • Create a centralized logging infrastructure in AWS
  • Build and deploy multiple application environments for different software development processes
  • Create queries that will return targeted logs from log indexes
  • Ingest, store, and analyze application logs with Elasticsearch
  • Collect, filter, and output application logs with Fluentd
  • Search logs with Kibana
  • Create and maintain virtual infrastructure with Terraform

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Centralized Logging in the Cloud with Elasticsearch and Kibana project for free

team

monthly
annual
$49.99
$499.99
only $41.67 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Centralized Logging in the Cloud with Elasticsearch and Kibana project for free