Centralized Logging on AWS

About this example

Centralized logging is pivotal for managing logs across distributed services. Here’s a breakdown of this example:

• Log ingestion: Captures logs using Amazon CloudWatch Logs from various AWS services like AWS CloudTrail, Amazon EC2, and VPC Flow Logs.
• Log indexing: Utilizes Amazon Kinesis Data Streams and AWS Lambda for data processing before persisting logs in Amazon S3.
• Visualization: Implements Amazon OpenSearch Service within a VPC for log data analysis and leverages Kibana for visualizations, secured by Amazon Cognito.
• Multi-account Strategy: Showcases log aggregation from multiple accounts for a unified logging layer.

When to use

• Complex Systems Monitoring: When you need to aggregate logs across multiple AWS services and accounts for a unified view.
• Security and Compliance: In scenarios where tracking and analyzing access and flow logs are critical for compliance audits.
• Performance Optimization: For identifying performance bottlenecks and optimizing resource utilization within cloud environments.

How to use

1. Start editing: Duplicate the example file and double click on the diagram.
2. Customize diagram: Add or modify nodes, groups, and relationships using simple diagram-as-code syntax. Use icons where possible to make the diagram intuitive.
3. Customize layout: Drag elements on the diagram directly on the canvas to manipulate layout to your preferences.
4. Collect feedback: Share the file with collaborators and encourage them to use the comments feature for feedback.