The final day of AWS re:Invent, 2019
In our final day at AWS re:Invent, and last overview piece, we’re covering the final keynote in-depth.
Overview of Werner Vogels Keynote:
The Power of AWS Nitro
Under the hood, AWS continues to innovate and improve the performance of the latest generation of EC2 instances. AWS EC2 Nitro now supports 36% faster Amazon EBS-Optimized Instance bandwidth up to 19 Gbps for the all-new C5/C5d/C5n, M5/M5d/M5n/M5dn, R5/R5d/R5n/R5dn, and P3dn instances now support 36% higher EBS-optimized instances. Also, 6, 9, and 12 TB Amazon EC2 High Memory instances can now support 19 Gbps of EBS-optimized instance bandwidth, a 36% increase from 14 Gbps.
For storage-intensive workloads, AWS Customers will have an opportunity to use smaller instance sizes and still meet EBS-optimized instance performance requirements, thereby saving costs. AWS Nitro has also enabled other powerful AWS services including AWS Outposts (AWS Infrastructure and service brought to your data center) and FireCracker (Virtualization Technology and Open Source Project for Running lightweight Multi-Tenant Container Workloads).
AWS Builder’s Library
Another exciting announcement was the Amazon Builder’s Library: a collection of published articles providing insight into how Amazon operates at scale. If you haven’t checked it out yet, we highly recommend taking a quick glance at the new builder’s library as soon as you can! This announcement will be incredibly useful for both Linux Academy and our Learners—providing access to in-depth articles created by Architects, Engineers, and Leaders from inside AWS.
Jeff Barr himself personally referenced two articles in his AWS News Blog Post — namely the “Avoiding insurmountable queue backlogs” and “Challenges with distributed systems”. We have personally gone through an article titled “Timeouts, retries, and backoff with jitter” written by Marc Brooker and found the article fantastic! The article discusses several topics, such as how to find ideal timeout settings based upon latency metrics, retry methodologies (such as exponential backoff), and jitter considerations (and how this impacts retry methodology). Keep in mind, AWS will continue to add articles to this library over time, so check back often!
Amazon Athena Query Enhancements
Amazon Athena now enables federated SQL queries allowing users to query the data in-place from data stored in relational, non-relational, object, and custom data sources. Analysts can use familiar SQL constructs to JOIN data across multiple data sources. This provides for quick analysis and subsequent ability to store results in Amazon S3 for use.
Athena executes federated queries using Athena Data Source Connectors that run on AWS Lambda. AWS has open-sourced Data Source connectors for Amazon DynamoDB, Apache HBase, Amazon Document DB, Amazon Redshift, AWS CloudWatch, AWS CloudWatch Metrics, and JDBC-compliant relational databases such as MySQL, and PostgreSQL
In addition to the Federated SQL queries, Amazon Athena now supports user-defined functions (UDFs). This enables customers, allowing them to write scalar functions and then invoke those functions via SQL queries directly. Athena federated query and user-defined functions are available in Preview in the us-east-1 (N. Virginia) region. Begin your Preview now by following these steps.
AWS Machine Learning (ML) Embark program Launched
AWS announced the AWS Machine Learning (ML) Embark program to help companies transform their development teams into machine learning practitioners. AWS ML Embark was developed based on Amazon’s own ML experience and thousands of successful customer implementations.
The program includes:
- guided instruction from AWS machine learning experts
- a discovery workshop, a hand-selected curriculum from the Machine Learning University
- an AWS DeepRacer event
- and co-development of a machine learning proof of concept at the culmination of the program.
New Express Workflows for AWS Step Functions
The new AWS Step Functions Express Workflows type uses in-memory processing for fast, high-event-rate workloads of up to 100,000 state transitions per second, for a total workflow duration of up to 5 minutes. The new Express Workflows can be used for IoT data ingestion, mobile backends, and other high-throughput use-cases. Existing workflows in AWS Step Functions are now called Standard Workflows.
Where to Go From Here
That wraps up the Thursday Keynote summary for re:Invent 2019.
Please reach out to us on the Linux Academy Community slack with:
- Your favorite features or services announced this year
- Any crazy, hilarious, or awesome re:Invent 2019 stories
- What Linux Academy can do to better serve you
- Anything you wanted to see that wasn’t at the event this year.
Thank you for another great year of re:Invent memories. It was a pleasure to see familiar faces, make new friends and share in your lifelong stories of success. We can’t wait to do it all over again in a year and hear what you’ve been up to. We are honored to help you build your dreams, whatever they may look like.
Post by: Miles Baker and Kelby Enevold