Choices
AWS:
Amazon CloudWatch
A monitoring and logging service that provides real-time insights into AWS resources, applications, and services. It allows you to collect, view, and analyze log data from various sources, including EC2 instances, Lambda functions, and custom applications.
AWS CloudTrail
A service that records API calls and events for your AWS account, including actions taken through the AWS Management Console, AWS SDKs, command-line tools, and other AWS services.
Amazon S3
A highly scalable and durable object storage service that can be used to store and access log files generated by AWS services, such as CloudFront and Elastic Load Balancing.
Azure:
Azure Monitor
A centralized logging and monitoring solution that provides a comprehensive view of your Azure resources, applications, and services. It supports various data types, including logs, metrics, and traces.
Azure Log Analytics
A cloud-based log management solution that allows you to collect, analyze, and visualize log data from various sources, such as virtual machines, containers, and custom applications.
Azure Event Hubs
A real-time data streaming service that can be used to ingest and process large amounts of event data, including logs and telemetry data.
GCP:
Google Cloud Logging
A fully managed logging service that allows you to store, search, and analyze log data from various GCP services and custom applications. It supports both structured and unstructured data.
Google Cloud Pub/Sub
A real-time messaging service that can be used to collect and process log data from various sources, including GCP services and custom applications.
Google Cloud Storage
A highly scalable and durable object storage service that can be used to store and access log files generated by GCP services, such as Compute Engine and Kubernetes Engine.
Other tools:
Elasticsearch
A distributed search and analytics engine that can be used to store and search log data. It supports various data formats, including JSON, CSV, and XML.
Fluentd
An open-source data collector that can be used to collect, transform, and forward log data from various sources to different destinations, such as Elasticsearch and Amazon S3.
Splunk
A platform for machine data that provides real-time visibility and insights into log data from various sources, such as servers, applications, and devices. It supports various data formats and can be deployed on-premises or in the cloud.