Skip to content

AWS

AWS

AWS is a one of the main cloud provider, supported by Amazon. It offers services for storage (S3, Glacier, EBS, ...), for networking (Snowball, CloudFront, ...), for computing (EC2, ECS, EKS, ...) and others. This module provides triggers to collect events from AWS

Configuration

Name Type Description
aws_access_key string The identifier of the access key
aws_secret_access_key string The secret associated to the access key
aws_region_name string The area hosting the AWS resources

Triggers

Fetch CloudTrail logs (deprecated)

Get the last records from CloudTrail (deprecated in flavor of Fetch new CloudTrail records on S3)

Arguments

Name Type Description
frequency integer Batch frequency in seconds
bucket_name string The bucket that contains CloudTrail logs
prefix string Limits the response to keys that begin with the specified prefix
chunk_size integer The size of chunks for the batch processing

Outputs

Name Type Description
records array A list of CloudTrail log records
records_path string The filename containing the records

Fetch Flowlog records (deprecated)

Get the last records from FlowLog (deprecated in flavor of Fetch new logs on S3)

Arguments

Name Type Description
frequency integer Batch frequency in seconds
bucket_name string The bucket that contains Flowlog records
prefix string Limits the response to keys that begin with the specified prefix
chunk_size integer The size of chunks for the batch processing

Outputs

Name Type Description
records array A list of Flowlog records
records_path string The filename containing the records

[BETA] Fetch new CloudFront logs on S3

Get all CloudFront records from S3

Arguments

Name Type Description
frequency integer Batch frequency in seconds
queue_name string The name of the SQS queue that received the notifications of the creation of S3 objects
chunk_size integer The size of chunks for the batch processing
separator string The separator used between each records (default: the linefeed character '\n')
skip_first integer The number of records to skip at the begining of each S3 object (default: 0)
delete_consumed_messages boolean Flag to delete consuming messages (default: false)
intake_server string Server of the intake server (e.g. 'https://intake.sekoia.io')
intake_key string Intake key to use when sending events

Fetch new Flowlogs on S3

Get line-oriented Flowlog records from new S3 objects based on notifications

Arguments

Name Type Description
frequency integer Batch frequency in seconds
queue_name string The name of the SQS queue that received the notifications of the creation of S3 objects
chunk_size integer The size of chunks for the batch processing
separator string The separator used between each records (default: the linefeed character '\n')
skip_first integer The number of records to skip at the begining of each S3 object (default: 0)
ignore_comments boolean Flag to ignore commented lines (starting with the character #; default: false)
delete_consumed_messages boolean Flag to delete consuming messages (default: false)
intake_server string Server of the intake server (e.g. 'https://intake.sekoia.io')
intake_key string Intake key to use when sending events

Fetch new FlowLogs Parquet records on S3

Get FlowLogs records from new S3 Parquet objects based on notifications

Arguments

Name Type Description
frequency integer Batch frequency in seconds
queue_name string The name of the SQS queue that received the notifications of the creation of S3 objects
delete_consumed_messages boolean Flag to delete consuming messages (default: false)
chunk_size integer The size of chunks for the batch processing
intake_server string Server of the intake server (e.g. 'https://intake.sekoia.io')
intake_key string Intake key to use when sending events

Fetch new logs on S3

Get line-oriented records from new S3 objects based on notifications

Arguments

Name Type Description
frequency integer Batch frequency in seconds
queue_name string The name of the SQS queue that received the notifications of the creation of S3 objects
chunk_size integer The size of chunks for the batch processing
separator string The separator used between each records (default: the linefeed character '\n')
skip_first integer The number of records to skip at the begining of each S3 object (default: 0)
ignore_comments boolean Flag to ignore commented lines (starting with the character #; default: false)
delete_consumed_messages boolean Flag to delete consuming messages (default: false)
intake_server string Server of the intake server (e.g. 'https://intake.sekoia.io')
intake_key string Intake key to use when sending events

Fetch new CloudTrail records on S3

Get Cloudtrail records from new S3 objects based on notifications

Arguments

Name Type Description
frequency integer Batch frequency in seconds
queue_name string The name of the SQS queue that received the notifications of the creation of S3 objects
delete_consumed_messages boolean Flag to delete consuming messages (default: false)
chunk_size integer The size of chunks for the batch processing
intake_server string Server of the intake server (e.g. 'https://intake.sekoia.io')
intake_key string Intake key to use when sending events

Fetch new messages from the SQS

Get messages from SQS

Arguments

Name Type Description
frequency integer Batch frequency in seconds
queue_name string The name of the SQS queue
delete_consumed_messages boolean Flag to delete consuming messages (default: false)
chunk_size integer The size of chunks for the batch processing
intake_server string Server of the intake server (e.g. 'https://intake.sekoia.io')
intake_key string Intake key to use when sending events

Extra

Module AWS v1.29.6