30 Aug 2016 in Kubernetes, logging, Elasticsearch, Kibana

Kubernetes Logging With Elasticsearch and Kibana

Developers, system administrators, and other stakeholders need to access system logs on a daily (sometimes even hourly) basis.

Logs from a couple of servers are easy to generate and handle. But, imagine a Kubernetes cluster with several pods running. Handling and storing logs in itself becomes a huge task.

How does the system administrator collect, manage, and query the logs of the system pods? How does a user query the logs of their application, which is composed of many pods, all of which may be restarted or automatically created by Kubernetes?

Thankfully, Kubernetes supports cluster level logging.

Cluster level logging allows collecting logs for all the pods in the cluster, at a centralized location, with options to search and view the logs.

There are two ways you can use the cluster level logging: either via Google Cloud Logging or Elasticsearch and Kibana.

It is important to note here that the default logging components may vary based on the Kubernetes distribution you are using. For example, if you are running Kubernetes on a Google Container Engine (GKE) cluster, you'll have Google Cloud Logging. But if you're running your Kubernetes cluster on AWS EC2, you'll have Elasticsearch and Kibana available by default.

In this post we'll focus on Kubernetes on an AWS EC2 instance. We'll learn how to set up a Kubernetes cluster on an AWS EC2 instance and ingest logs into Elasticsearch and view them using Kibana.

But first, let's make some introductions.

Read More
29 Aug 2016 in Workflow, Stackpoint Cloud

Stackpoint Cloud and Deis Workflow

Stackpoint Cloud provides a simple and easy to use interface to provision Kubernetes on a variety of clouds. Whether you are on Amazon, Azure, Digital Ocean, or Packet, Stackpoint Cloud is a great way to get started with Kubernetes.

We announced a new collaboration at the beginning of August. Not slowing down, Stackpoint has added support for Kubernetes 1.3.5 and Deis Workflow 2.4.

This guide shows just how easy it is to bring up a Stackpoint Kubernetes cluster with Deis Workflow automatically installed and configured.

Stackpoint and Workflow Overview

Read More
24 Aug 2016 in Workflow

Private Applications on Workflow

Last week, we released Workflow v2.4.

In Workflow v2.4, we added something called deis routing. This feature allows you to add or remove an application from the routing layer. If you remove an application from the routing layer, it continues to run within the cluster while being unreachable from the outside world.

If you remove an application from the routing layer, the application is still reachable internally thanks to Kubernetes services. This allows for some pretty neat interactions where users can run internal service APIs or backing services like postgres without exposing it to the outside world.

In this post, I'll take a closer look at this new feature and show you how and why you'd want to use it with your application.

Read More
22 Aug 2016 in monitoring, Workflow, Sysdig

Monitoring Deis Workflow with Sysdig Cloud

Deis Workflow is an open source Platform as a Service that works with and compliments Kubernetes. This is great if you want a Heroku-inspired workflow for easily deploying your container-based apps to the cloud.

But what if you want to monitor them as well and get insight into app performance? That's where Sysdig Cloud comes in.

Sysdig Cloud is "container-native monitoring". It comes with built in integration for many popular server software products, gives you a realtime dashboard, historical replay, dynamic topology mapping, and alerting. It also natively integrates with Kubernetes so that you can monitor your services as well as your containers and hosts.

So let's combine these two products!

In this post I am going to show you how to monitor Deis Workflow with Sysdig Cloud.

Read More
19 Aug 2016 in Workflow, Release, Announcement

Deis Workflow 2.4 Release

The Deis Workflow team continues to ship great features every two weeks. I am starting to run out of pithy intros for these release announcements. So I'll let DEVO take it from here.

When a feature comes along, you must ship it.

Read More