Audit logs
Overview
Cloudflare is a global network designed to make everything you connect to the Internet secure, private, fast, and reliable.
In this documentation, you will learn how to collect and send Cloudflare Audit logs to SEKOIA.IO.
Related Built-in Rules
Benefit from SEKOIA.IO built-in rules and upgrade Cloudflare Audit Logs with the following detection capabilities out-of-the-box.
SEKOIA.IO x Cloudflare Audit Logs on ATT&CK Navigator
SEKOIA.IO Intelligence Feed
Detect threats based on indicators of compromise (IOCs) collected by SEKOIA's Threat and Detection Research team.
- Effort: elementary
Event Categories
The following table lists the data source offered by this integration.
Data Source | Description |
---|---|
Authentication logs |
Cloudflare Access logs an authentication event whenever a user or service attempts to log in to an application, whether the attempt succeeds or not. |
In details, the following table denotes the type of events produced by this integration.
Name | Values |
---|---|
Kind | event |
Category | network |
Type | access |
Event Samples
Find below few samples of events and how they are normalized by SEKOIA.IO.
{
"message": "{\"ActionResult\":true,\"ActionType\":\"gateway_create\",\"ActorEmail\":\"john.doe@example.org\",\"ActorID\":\"042fb38530054d63921f9ca81a33d5d2\",\"ActorIP\":\"::ffff:78.197.123.35\",\"ActorType\":\"user\",\"ID\":\"f6773c1b-c332-4d33-8a5b-3e7f6fafde46\",\"Interface\":\"UI\",\"Metadata\":{\"account_id\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"actor_email\":\"john.doe@example.org\"},\"NewValue\":{\"id\":\"09cec157-0de7-4143-8c08-d905c6e1be76\",\"name\":\"Redirect twitter\",\"description\":\"\",\"precedence\":14000,\"enabled\":true,\"action\":\"l4_override\",\"filters\":[\"l4\"],\"created_at\":\"2023-02-24T16:32:38Z\",\"updated_at\":\"2023-02-24T16:32:38Z\",\"deleted_at\":null,\"conditions\":[{\"id\":\"e588f14e-017b-4484-93e0-02a5746ededa\",\"type\":\"traffic\",\"expression\":{\"==\":{\"lhs\":\"net.dst.ip\",\"rhs\":{\"ip\":\"104.244.42.65\"}}},\"created_at\":\"2023-02-24T16:32:38Z\",\"updated_at\":\"2023-02-24T16:32:38Z\",\"deleted_at\":null}],\"traffic\":\"net.dst.ip == 104.244.42.65\",\"identity\":\"\",\"device_posture\":\"\",\"version\":1,\"rule_settings\":{\"block_page_enabled\":false,\"block_reason\":\"\",\"override_ips\":null,\"override_host\":\"\",\"l4override\":{\"ip\":\"145.239.192.199\"},\"biso_admin_controls\":{\"dp\":false,\"dcp\":false,\"dd\":false,\"du\":false,\"dk\":false,\"dcr\":false},\"add_headers\":{},\"ip_categories\":false,\"check_session\":null,\"insecure_disable_dnssec_validation\":false}},\"OldValue\":null,\"OwnerID\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"ResourceID\":\"09cec157-0de7-4143-8c08-d905c6e1be76\",\"ResourceType\":\"gateway.rule\",\"When\":\"2023-02-24T16:32:38Z\"}",
"event": {
"action": "gateway_create",
"category": [
"network"
],
"dataset": "audit_logs",
"kind": "event",
"type": [
"access"
]
},
"@timestamp": "2023-02-24T16:32:38Z",
"cloud": {
"account": {
"id": "1d1e650b3385b95db72bba7cfb1287e9"
}
},
"observer": {
"type": "proxy",
"vendor": "Cloudflare"
},
"user": {
"email": "john.doe@example.org",
"id": "042fb38530054d63921f9ca81a33d5d2"
},
"source": {
"ip": "78.197.123.35",
"address": "78.197.123.35"
},
"cloudflare": {
"ActionResult": true,
"ActorType": "user",
"ID": "f6773c1b-c332-4d33-8a5b-3e7f6fafde46",
"Interface": "UI",
"ResourceID": "09cec157-0de7-4143-8c08-d905c6e1be76",
"ResourceType": "gateway.rule"
},
"related": {
"ip": [
"78.197.123.35"
]
}
}
{
"message": "{\"ActionResult\":true,\"ActionType\":\"gateway_create_location\",\"ActorEmail\":\"john.doe@example.org\",\"ActorID\":\"042fb38530054d63921f9ca81a33d5d2\",\"ActorIP\":\"::ffff:78.197.123.35\",\"ActorType\":\"user\",\"ID\":\"5cd42473-600e-4610-a85e-ab194b8155ae\",\"Interface\":\"UI\",\"Metadata\":{\"Request\":{\"client_default\":false,\"linked_policies\":null,\"name\":\"AWS VM\",\"networks\":[{\"network\":\"15.188.186.81/32\"}]},\"account_id\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"action_detail\":\"create gateway location\",\"actor_email\":\"john.doe@example.org\",\"location_name\":\"AWS VM\"},\"NewValue\":{\"name\":\"AWS VM\",\"networks\":[{\"network\":\"15.188.186.81/32\"}],\"linked_policies\":null,\"client_default\":false},\"OldValue\":{},\"OwnerID\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"ResourceID\":\"a26c188f10c243338ed4c823fafa06f6\",\"ResourceType\":\"gateway.location\",\"When\":\"2023-02-24T15:09:53Z\"}",
"event": {
"action": "gateway_create_location",
"category": [
"network"
],
"dataset": "audit_logs",
"kind": "event",
"type": [
"access"
]
},
"@timestamp": "2023-02-24T15:09:53Z",
"cloud": {
"account": {
"id": "1d1e650b3385b95db72bba7cfb1287e9"
}
},
"observer": {
"type": "proxy",
"vendor": "Cloudflare"
},
"user": {
"email": "john.doe@example.org",
"id": "042fb38530054d63921f9ca81a33d5d2"
},
"source": {
"ip": "78.197.123.35",
"address": "78.197.123.35"
},
"cloudflare": {
"ActionResult": true,
"ActorType": "user",
"ID": "5cd42473-600e-4610-a85e-ab194b8155ae",
"request_client_default": false,
"request_name": "AWS VM",
"request_networks": [
{
"network": "15.188.186.81/32"
}
],
"Interface": "UI",
"ResourceID": "a26c188f10c243338ed4c823fafa06f6",
"ResourceType": "gateway.location"
},
"related": {
"ip": [
"78.197.123.35"
]
}
}
{
"message": "{\"ActionType\":\"gateway_update\",\"ActorEmail\":\"john.doe@example.org\",\"ActorID\":\"042fb38530054d63921f9ca81a33d5d2\",\"ActorIP\":\"::ffff:78.197.123.35\",\"ActorType\":\"user\",\"ID\":\"3cca43bb-2fb4-4acf-bfe8-06f12e3cce84\",\"Interface\":\"UI\",\"Metadata\":{\"account_id\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"actor_email\":\"john.doe@example.org\"},\"NewValue\":{\"settings\":{\"antivirus\":{\"enabled_download_phase\":true,\"enabled_upload_phase\":true,\"fail_closed\":true},\"tls_decrypt\":{\"enabled\":true},\"activity_log\":{\"enabled\":true},\"block_page\":null,\"fips\":{\"tls\":false}},\"created_at\":\"2023-02-17T08:38:16Z\",\"updated_at\":\"2023-02-24T16:17:11Z\"},\"OldValue\":null,\"OwnerID\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"ResourceID\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"ResourceType\":\"gateway.config\",\"When\":\"2023-02-24T16:17:10Z\"}",
"event": {
"action": "gateway_update",
"category": [
"network"
],
"dataset": "audit_logs",
"kind": "event",
"type": [
"access"
]
},
"@timestamp": "2023-02-24T16:17:10Z",
"cloud": {
"account": {
"id": "1d1e650b3385b95db72bba7cfb1287e9"
}
},
"observer": {
"type": "proxy",
"vendor": "Cloudflare"
},
"user": {
"email": "john.doe@example.org",
"id": "042fb38530054d63921f9ca81a33d5d2"
},
"source": {
"ip": "78.197.123.35",
"address": "78.197.123.35"
},
"cloudflare": {
"ActorType": "user",
"ID": "3cca43bb-2fb4-4acf-bfe8-06f12e3cce84",
"Interface": "UI",
"ResourceID": "1d1e650b3385b95db72bba7cfb1287e9",
"ResourceType": "gateway.config"
},
"related": {
"ip": [
"78.197.123.35"
]
}
}
{
"message": "{\"ActionResult\":true,\"ActionType\":\"job_create\",\"ActorEmail\":\"john.doe@example.org\",\"ActorID\":\"042fb38530054d63921f9ca81a33d5d2\",\"ActorIP\":\"::ffff:78.197.123.35\",\"ActorType\":\"user\",\"ID\":\"abc4831a-502a-4e05-a11f-7151dbce21a8\",\"Interface\":\"API\",\"Metadata\":{\"actor_email\":\"john.doe@example.org\"},\"NewValue\":{\"id\":184770,\"dataset\":\"casb_findings\",\"name\":\"\",\"logpull_options\":\"timestamps=rfc3339\\u0026fields=AssetDisplayName,AssetExternalID,AssetLink,AssetMetadata,DetectedTimestamp,FindingTypeDisplayName,FindingTypeID,FindingTypeSeverity,InstanceID,IntegrationDisplayName,IntegrationID,IntegrationPolicyVendor\",\"destination_conf\":\"https://intake.sekoia.io/plain/batch\",\"enabled\":true,\"frequency\":\"high\",\"kind\":\"\",\"max_upload_bytes\":5000000,\"max_upload_records\":1000},\"OldValue\":{},\"OwnerID\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"ResourceID\":\"184770\",\"ResourceType\":\"logpush job\",\"When\":\"2023-02-24T14:51:23Z\"}",
"event": {
"action": "job_create",
"category": [
"network"
],
"dataset": "audit_logs",
"kind": "event",
"type": [
"access"
]
},
"@timestamp": "2023-02-24T14:51:23Z",
"cloud": {
"account": {
"id": "1d1e650b3385b95db72bba7cfb1287e9"
}
},
"observer": {
"type": "proxy",
"vendor": "Cloudflare"
},
"user": {
"email": "john.doe@example.org",
"id": "042fb38530054d63921f9ca81a33d5d2"
},
"source": {
"ip": "78.197.123.35",
"address": "78.197.123.35"
},
"cloudflare": {
"ActionResult": true,
"ActorType": "user",
"ID": "abc4831a-502a-4e05-a11f-7151dbce21a8",
"Interface": "API",
"ResourceID": "184770",
"ResourceType": "logpush job"
},
"related": {
"ip": [
"78.197.123.35"
]
}
}
{
"message": "{\"ActionResult\":true,\"ActionType\":\"job_update\",\"ActorEmail\":\"john.doe@example.org\",\"ActorID\":\"042fb38530054d63921f9ca81a33d5d2\",\"ActorIP\":\"::ffff:78.197.123.35\",\"ActorType\":\"user\",\"ID\":\"90c1f5cb-f7e0-48bf-9021-14cb2102a2e1\",\"Interface\":\"UI\",\"Metadata\":{\"actor_email\":\"john.doe@example.org\",\"zone_name\":\"foo-bar-baz.xyz\",\"zone_tag\":\"284fc005c3dfd7e2f3c602aaa5dabac9\"},\"NewValue\":{\"id\":183719,\"dataset\":\"http_requests\",\"name\":\"\",\"logpull_options\":\"fields=ClientIP,ClientRequestHost,ClientRequestMethod,ClientRequestURI,EdgeEndTimestamp,EdgeResponseBytes,EdgeResponseStatus,EdgeStartTimestamp,RayID,BotDetectionIDs,BotScore,BotScoreSrc,BotTags,CacheCacheStatus,CacheReserveUsed,CacheResponseBytes,CacheResponseStatus,CacheTieredFill,ClientASN,ClientCountry,ClientDeviceType,ClientIPClass,ClientMTLSAuthCertFingerprint,ClientMTLSAuthStatus,ClientRegionCode,ClientRequestBytes,ClientRequestPath,ClientRequestProtocol,ClientRequestReferer,ClientRequestScheme,ClientRequestSource,ClientRequestUserAgent,ClientSSLCipher,ClientSSLProtocol,ClientSrcPort,ClientTCPRTTMs,ClientXRequestedWith,ContentScanObjResults,ContentScanObjTypes,Cookies,EdgeCFConnectingO2O,EdgeColoCode,EdgeColoID,EdgePathingOp,EdgePathingSrc,EdgePathingStatus,EdgeRateLimitAction,EdgeRateLimitID,EdgeRequestHost,EdgeResponseBodyBytes,EdgeResponseCompressionRatio,EdgeResponseContentType,EdgeServerIP,EdgeTimeToFirstByteMs,FirewallMatchesActions,FirewallMatchesRuleIDs,FirewallMatchesSources,JA3Hash,OriginDNSResponseTimeMs,OriginIP,OriginRequestHeaderSendDurationMs,OriginResponseBytes,OriginResponseDurationMs,OriginResponseHTTPExpires,OriginResponseHTTPLastModified,OriginResponseHeaderReceiveDurationMs,OriginResponseStatus,OriginResponseTime,OriginSSLProtocol,OriginTCPHandshakeDurationMs,OriginTLSHandshakeDurationMs,ParentRayID,RequestHeaders,ResponseHeaders,SecurityLevel,SmartRouteColoID,UpperTierColoID,WAFAction,WAFAttackScore,WAFFlags,WAFMatchedVar,WAFProfile,WAFRCEAttackScore,WAFRuleID,WAFRuleMessage,WAFSQLiAttackScore,WAFXSSAttackScore,WorkerCPUTime,WorkerStatus,WorkerSubrequest,WorkerSubrequestCount,WorkerWallTimeUs,ZoneName\\u0026timestamps=rfc3339\\u0026CVE-2021-44228=false\",\"destination_conf\":\"https://intake.sekoia.io/plain/batch\",\"enabled\":true,\"logstream\":true,\"frequency\":\"high\",\"kind\":\"\",\"max_upload_bytes\":5000000,\"max_upload_records\":1000},\"OldValue\":{\"id\":183719,\"dataset\":\"http_requests\",\"name\":\"\",\"logpull_options\":\"fields=ClientIP,ClientRequestHost,ClientRequestMethod,ClientRequestURI,EdgeEndTimestamp,EdgeResponseBytes,EdgeResponseStatus,EdgeStartTimestamp,RayID\\u0026timestamps=rfc3339\",\"destination_conf\":\"https://intake.sekoia.io/plain/batch\",\"enabled\":true,\"logstream\":true,\"frequency\":\"high\",\"kind\":\"\",\"max_upload_bytes\":5000000,\"max_upload_records\":1000},\"OwnerID\":\"1d1e650b3385b95db72bba7cfb1287e9\",\"ResourceID\":\"183719\",\"ResourceType\":\"logpush job\",\"When\":\"2023-02-24T17:00:39Z\"}",
"event": {
"action": "job_update",
"category": [
"network"
],
"dataset": "audit_logs",
"kind": "event",
"type": [
"access"
]
},
"@timestamp": "2023-02-24T17:00:39Z",
"cloud": {
"account": {
"id": "1d1e650b3385b95db72bba7cfb1287e9"
}
},
"observer": {
"type": "proxy",
"vendor": "Cloudflare"
},
"user": {
"email": "john.doe@example.org",
"id": "042fb38530054d63921f9ca81a33d5d2"
},
"source": {
"ip": "78.197.123.35",
"address": "78.197.123.35"
},
"cloudflare": {
"ActionResult": true,
"ActorType": "user",
"ID": "90c1f5cb-f7e0-48bf-9021-14cb2102a2e1",
"zone_tag": "284fc005c3dfd7e2f3c602aaa5dabac9",
"zone_name": "foo-bar-baz.xyz",
"Interface": "UI",
"ResourceID": "183719",
"ResourceType": "logpush job"
},
"related": {
"ip": [
"78.197.123.35"
]
}
}
Extracted Fields
The following table lists the fields that are extracted, normalized under the ECS format, analyzed and indexed by the parser. It should be noted that infered fields are not listed.
Name | Type | Description |
---|---|---|
@timestamp |
date |
Date/time when the event originated. |
cloud.account.id |
keyword |
The cloud account or organization id. |
cloudflare.ActionResult |
boolean |
Whether the action was successful. |
cloudflare.ActorType |
keyword |
Type of user that started the audit trail. |
cloudflare.ID |
keyword |
Unique identifier of an audit log. |
cloudflare.Interface |
keyword |
Entry point or interface of the audit log. |
cloudflare.ResourceID |
keyword |
Unique identifier of the resource within Cloudflare’s system. |
cloudflare.ResourceType |
keyword |
The type of resource that was changed. |
cloudflare.request_client_default |
boolean |
Additional audit log-specific information. |
cloudflare.request_name |
keyword |
Additional audit log-specific information. |
cloudflare.request_networks |
list |
Additional audit log-specific information. |
cloudflare.zone_name |
keyword |
Additional audit log-specific information. |
cloudflare.zone_tag |
keyword |
Additional audit log-specific information. |
event.action |
keyword |
The action captured by the event. |
event.category |
keyword |
Event category. The second categorization field in the hierarchy. |
event.dataset |
keyword |
Name of the dataset. |
event.kind |
keyword |
The kind of the event. The highest categorization field in the hierarchy. |
event.type |
keyword |
Event type. The third categorization field in the hierarchy. |
observer.type |
keyword |
The type of the observer the data is coming from. |
observer.vendor |
keyword |
Vendor name of the observer. |
source.ip |
ip |
IP address of the source. |
user.email |
keyword |
User email address. |
user.id |
keyword |
Unique identifier of the user. |
Configuration
Create the intake on SEKOIA.IO
Go to the intake page and create a new intake from the format Cloudflare.
Configure events forwarding on Cloudflare
Retrieve necessary information
First, you will have to retrieve configuration information. Connect to Cloudflare Console to collect the following :
-
Cloudflare API Token
- Go to
My Profile
, then on the left panel, click onAPI Tokens
. - Click on the
Create Token
button and select theCreate Custom Token
entry. - Give a name to your token and set the following permissions:
Scope Group Level Account Account Analytics Read Account Logs Read Account Logs Edit Zone Logs Read Zone Logs Edit - If you want zerotrust logs you should also add:
Scope Group Level Account Zero Trust Read - Go to
-
Cloudflare Zone ID :
- This information is specific to a Website.
- On the left panel, click on
Websites
and select the Website you want. - On the right panel, there is an
API
section where you can retrieve theZone ID
.
Create a Logpush job
Configure a Logpush job with the following destination:
https://intake.sekoia.io/plain/batch?header_X-SEKOIAIO-INTAKE-KEY=<YOUR_INTAKE_KEY>
To do so, you can manage Logpush with cURL:
$ curl -X POST 'https://api.cloudflare.com/client/v4/accounts/<CLOUDFLARE_ACCOUNT_ID>/logpush/jobs' \
-H 'Authorization: Bearer <CLOUDFLARE_API_TOKEN>' \
-H "Content-Type: application/json" \
-d '{
"dataset": "audit_logs",
"enabled": true,
"max_upload_bytes": 5000000,
"max_upload_records": 1000,
"logpull_options":"fields=ActionResult,ActionType,ActorEmail,ActorID,ActorIP,ActorType,ID,Interface,Metadata,NewValue,OldValue,OwnerID,ResourceID,ResourceType,When×tamps=rfc3339",
"destination_conf": "https://intake.sekoia.io/plain/batch?header_X-SEKOIAIO-INTAKE-KEY=<YOUR_INTAKE_KEY>"
}' # (1)
- will return
{ "errors": [], "messages": [], "result": { "id": "<ID>", "dataset": "audit_logs", "frequency":"high", "kind":"", "max_upload_bytes": 5000000, "max_upload_records": 1000, "enabled": true, "name": "<DOMAIN_NAME>", "logpull_options": "fields=<LIST_OF_FIELDS>", "destination_conf": "https://intake.sekoia.io/plain/batch?header_X-SEKOIAIO-INTAKE-KEY=<YOUR_INTAKE_KEY>", "last_complete": null, "last_error": null, "error_message": null, "time_created":"<TIMESTAMP>" }, "success": true }
Important
Replace :
<YOUR_INTAKE_KEY>
with the Intake key you generated in the Create the intake on SEKOIA.IO step.<CLOUDFLARE_ACCOUNT_ID>
with the ACCOUNT_ID found on the overview page<CLOUDFLARE_API_TOKEN>
with the API Token you generated
Useful Cloudflare API endpoints
On their documentation, Cloudflare provides a list API endpoints you can use. Find below some useful endpoints:
https://api.cloudflare.com/client/v4/accounts/<ACCOUNT_ID>/logpush/jobs/<JOB_ID>
to verify the job you previously created is correct (you need to specify theJOB_ID
)https://api.cloudflare.com/client/v4/accounts/<ACCOUNT_ID>/logpush/datasets/<DATASET>/jobs
to get all the jobs for a specific dataset (dns_log
,firewalls_events
orhttp_requests
in our case)https://api.cloudflare.com/client/v4/accounts/<ACCOUNT_ID>/logpush/jobs/<JOB_ID>
to update a job if you noticed a mistake after the creation of the job (wrong fields, wrong SEKOIA API Key...)