Processing Messages in AWS with Auto Scaling and SQS Message Queues
In this hands-on lab, we will cover how an Auto Scaling group of EC2 instances can be used to process messages in an SQS queue based on queue size. This design uses the AWS Job Observer Pattern. In this pattern, the queue is monitored for increases and an Auto Scaling group scales accordingly. Amazon CloudWatch is essentially the observer. By setting an alarm on a metric for messages available in the queue, the CloudWatch alarm can trigger an Auto Scaling group to scale out when the message queue size exceeds the alarm value. We will configure this architecture and be able to test it by sending messages to the SQS queue.