Change log for AWS_VPC_FLOW

Date Changes
2026-06-05 Enhancement:
- Parser overhaul version to make it more efficient and increase fields coverage. You can see the full list of changes in the parser documentation page https://docs.cloud.google.com/chronicle/docs/ingestion/default-parsers/aws-vpc-flow.
2026-05-18 Enhancement:
- Added new grok patterns to parse SYSLOG format logs.
- event.idm.read_only_udm.network.sent_bytes: Removed mapping of bytes from event.idm.read_only_udm.network.sent_bytes as the same data is already and more appropriately captured by the event.idm.read_only_udm.network.received_bytes field.
- event.idm.read_only_udm.network.dhcp.flags: Removed mapping of tcp_flags from event.idm.read_only_udm.network.dhcp.flags as TCP flags are not applicable to the DHCP protocol.
- event.idm.read_only_udm.additional.fields: Removed mapping of protocol raw log field with event.idm.read_only_udm.additional.fields UDM field as this information is already correctly and semantically mapped to event.idm.read_only_udm.network.direction.
- event.idm.read_only_udm.about.resource.attribute.labels: Mapped flow_direction raw log field with event.idm.read_only_udm.about.resource.attribute.labels UDM field.
- event.idm.read_only_udm.additional.fields: Mapped tcp_flags raw log field to event.idm.read_only_udm.additional.fields UDM field.
2026-03-02 Enhancement:
- Added a new grok pattern in order to parse the logs with SYSLOG format.
- Added a conditional check for tcp_flags.
- event.idm.read_only_udm.principal.cloud.availability_zone: Removed mapping of tgw_src_az_id_zone,Az_id,az_id from event.idm.read_only_udm.principal.cloud.availability_zone UDM field. As it is a deprecated field.
- event.idm.read_only_udm.principal.location.name: Mapped tgw_src_az_id_zone,Az_id,az_id raw log field with event.idm.read_only_udm.principal.location.name UDM field.
- event.idm.read_only_udm.principal.cloud.vpc.id: Removed mapping of Vpc_id,vpcID,tgw_src_vpc_id from event.idm.read_only_udm.principal.cloud.vpc.id UDM field. As it is a deprecated field.
- event.idm.read_only_udm.principal.resource.attribute.labels: Mapped Vpc_id,vpcID,tgw_src_vpc_id raw log field with event.idm.read_only_udm.principal.resource.attribute.labels UDM field.
- event.idm.read_only_udm.target.cloud.vpc.id: Removed mapping of tgw_dst_vpc_id from event.idm.read_only_udm.target.cloud.vpc.id UDM field. As it is a deprecated field.
- event.idm.read_only_udm.target.resource.attribute.labels: Mapped tgw_dst_vpc_id raw log field with event.idm.read_only_udm.target.resource.attribute.labels UDM field.
2025-11-14 Enhancement:
- Added a new Grok pattern to parse a new pattern of logs.
- event.idm.read_only_udm.principal.ip and event.idm.read_only_udm.principal.asset.ip: Newly mapped interface_ip raw log field with event.idm.read_only_udm.principal.ip and event.idm.read_only_udm.principal.asset.ip UDM field.
- event.idm.read_only_udm.principal.port: Newly mapped src_port raw log field with event.idm.read_only_udm.principal.port UDM field.
- event.idm.read_only_udm.target.port: Newly mapped dst_port raw log field with event.idm.read_only_udm.target.port UDM field.
- event.idm.read_only_udm.network.direction: Newly mapped direction raw log field with event.idm.read_only_udm.network.direction UDM field.
- event.idm.read_only_udm.target.ip and event.idm.read_only_udm.target.asset.ip: Newly mapped dst_ip raw log field with event.idm.read_only_udm.target.ip and event.idm.read_only_udm.target.asset.ip UDM field.
- event.idm.read_only_udm.principal.location.country_or_region: Newly mapped region raw log field with event.idm.read_only_udm.principal.location.country_or_region UDM field.
- event.idm.read_only_udm.additional.fields: Newly mapped DeviceType raw log field with event.idm.read_only_udm.additional.fields UDM field.
- event.idm.read_only_udm.network.sent_bytes: Newly mapped bytes raw log field with event.idm.read_only_udm.network.sent_bytes UDM field.
2025-11-13 Enhancement:
- Added a new Grok pattern to parse a new pattern of logs.
2025-10-15 Enhancement:
- Added Grok patterns to parse the logs.
- Added a conditional check pkt_dstaddr_ip is not equal to dstaddr before mapping pkt_dstaddr_ip to intermediary.ip.
- Added a conditional check pkt_srcaddr_ip is not equal to srcaddr before mapping pkt_srcaddr_ip to intermediary.ip.
2025-09-03 Enhancement:
- Added Grok patterns to parse the unparsed logs.
- event.idm.read_only_udm.principal.cloud.availability_zone: Mapped tgw_src_az_id_zone raw log field with event.idm.read_only_udm.principal.cloud.availability_zone UDM field.
- event.idm.read_only_udm.target.resource.attribute.cloud.availability_zone: Mapped tgw_dst_az_id_zone raw log field with event.idm.read_only_udm.target.resource.attribute.cloud.availability_zone UDM field.
2025-06-25 Enhancement:
- Added Grok patterns to parse the unparsed logs.
- event.idm.read_only_udm.about.resource.attribute.labels: Removed mapping of interfaceId from event.idm.read_only_udm.about.resource.attribute.labels UDM field because interfaceId is associated with the user's unique identifier.
- event.idm.read_only_udm.principal.user.product_object_id: Mapped interfaceId raw log field with event.idm.read_only_udm.principal.user.product_object_id UDM field.
- event.idm.read_only_udm.principal.resource.attribute.labels: Removed mapping of vpcID from event.idm.read_only_udm.principal.resource.attribute.labels UDM field because vpcID represents the unique identifier for a Virtual Private Cloud.
- event.idm.read_only_udm.principal.cloud.vpc.id: Mapped vpcID raw log field with event.idm.read_only_udm.principal.cloud.vpc.id UDM field.
- event.idm.read_only_udm.about.resource.attribute.labels: Removed mapping of subnetID from event.idm.read_only_udm.about.resource.attribute.labels UDM field because subnetID is a unique identifier within a specific network or cloud environment.
- event.idm.read_only_udm.principal.asset_id: Mapped subnetID raw log field with event.idm.read_only_udm.principal.asset_id UDM field.
- event.idm.read_only_udm.additional.fields: Removed mapping of packets and pckts from event.idm.read_only_udm.additional.fields UDM field.
- event.idm.read_only_udm.network.sent_packets: Mapped packets and pckts raw log field with event.idm.read_only_udm.network.sent_packets UDM field because it is the number of network packets sent during a communication event.
- event.idm.read_only_udm.additional.fields: Removed mapping of bytes from event.idm.read_only_udm.additional.fields UDM field as it is already getting mapped in event.idm.read_only_udm.network.sent_bytes UDM field.
- event.idm.read_only_udm.network.direction: Newly mapped flow_direction raw log field with event.idm.read_only_udm.network.direction UDM field as INBOUND when flow_direction is ingress and as OUTBOUND when flow_direction is egress.
- event.idm.read_only_udm.about.resource.attribute.labels: Removed mapping of Tcp_flags from event.idm.read_only_udm.about.resource.attribute.labels UDM field because 'Tcp_flags. describes network protocol details, not attributes of a separate resource entity.
- event.idm.read_only_udm.network.dhcp.flags: Mapped Tcp_flags raw log field with event.idm.read_only_udm.network.dhcp.flags UDM field.
- event.idm.read_only_udm.about.resource.attribute.labels: Removed mapping of traffic_path from event.idm.read_only_udm.about.resource.attribute.labels UDM field because it represents a general, unstructured detail not fitting a specific UDM entity or attribute..
- event.idm.read_only_udm.additional.fields: Mapped traffic_path raw log field with event.idm.read_only_udm.additional.fields UDM field.
2025-06-06 Enhancement:
- event.idm.read_only_udm.about.resource.attribute.labels: Removed mapping of traffic_path from event.idm.read_only_udm.about.resource.attribute.labels UDM field.
- event.idm.read_only_udm.additional.fields: Mapped traffic_path raw log field with event.idm.read_only_udm.additional.fields UDM field.
- event.idm.read_only_udm.principal.resource.attribute.labels: Removed mapping of tgw_src_eni and tgw_src_subnet_id from event.idm.read_only_udm.principal.resource.attribute.labels UDM field.
- event.idm.read_only_udm.principal.user.product_object_id: Mapped tgw_src_eni raw log field with event.idm.read_only_udm.principal.user.product_object_id UDM field
- event.idm.read_only_udm.target.resource.attribute.labels: Removed mapping of tgw_dst_eni and tgw_dst_subnet_id from event.idm.read_only_udm.target.resource.attribute.labels UDM field.
- event.idm.read_only_udm.target.user.product_object_id: Mapped tgw_dst_eni raw log field with event.idm.read_only_udm.target.user.product_object_id UDM field.
- event.idm.read_only_udm.principal.asset_id: Mapped tgw_src_subnet_id raw log field with event.idm.read_only_udm.principal.asset_id UDM field
- event.idm.read_only_udm.target.asset_id: Mapped tgw_dst_subnet_id raw log field with event.idm.read_only_udm.target.asset_id UDM field.
- event.idm.read_only_udm.principal.resource.product_object_id: Removed mapping of tgw_src_vpc_id from event.idm.read_only_udm.principal.resource.product_object_id UDM field.
- event.idm.read_only_udm.principal.cloud.vpc.id: Mapped tgw_src_vpc_id raw log field with event.idm.read_only_udm.principal.cloud.vpc.id UDM field
- event.idm.read_only_udm.target.resource.product_object_id: Removed mapping of tgw_dst_vpc_id from event.idm.read_only_udm.target.resource.product_object_id UDM field.
- event.idm.read_only_udm.target.cloud.vpc.id: Mapped tgw_dst_vpc_id raw log field with event.idm.read_only_udm.target.cloud.vpc.id UDM field
- If tcp_flags is equal to tcp-flags then mapped tcp_flags to additional.fields UDM field else map tcp_flags to event.idm.read_only_udm.network.dhcp.flags.
2025-05-22 Enhancement:
- Modified the Grok patterns to parse the vpcID raw log field.
- Removed the Grok pattern where vpcID is equal to null.
- Added Grok patterns to parse the raw logs.
- Added gsub replace \\n with "".
- Added a conditional check if srcaddr, dstaddr, srcport and protocol not equals to null or - .
- Added a conditional check if protocol not equals to null or - before mapping UNKNOWN_IP_PROTOCOL to event.idm.read_only_udm.network.ip_protocol.
- event.idm.read_only_udm.additional.fields: Newly mapped action raw log field with event.idm.read_only_udm.additional.fields UDM field.
2025-04-29 Enhancement:
- Added a Grok pattern to parse vpcID raw log field.
2025-04-22 Enhancement:
- event.idm.read_only_udm.metadata.event_timestamp: Newly mapped Start raw log field with event.idm.read_only_udm.metadata.event_timestamp UDM field.
- event.idm.read_only_udm.metadata.event_timestamp: Newly mapped start_time_dt raw log field with event.idm.read_only_udm.metadata.event_timestamp UDM field.
- event.idm.read_only_udm.metadata.event_timestamp: Newly mapped Start_time_dt raw log field with event.idm.read_only_udm.metadata.event_timestamp UDM field.
- event.idm.read_only_udm.metadata.event_timestamp: Newly mapped start_time raw log field with event.idm.read_only_udm.metadata.event_timestamp UDM field.
- event.idm.read_only_udm.metadata.event_timestamp: Newly mapped start raw log field with event.idm.read_only_udm.metadata.event_timestamp UDM field.
2025-03-07 Enhancement:
- Modified a Grok pattern to parse droped logs.
- Added gsub to remove the extra part from Region field.
2025-02-14 Enhancement:
- Added a fix to map interfaceId to about.resource.attribute.labels.
2025-02-05 Enhancement:
- If flow_direction is ingress then mapped packets to network.received_packets.
- If flow_direction is ingress then mapped traffic.packets to network.received_packets.
- If flow_direction is ingress then mapped Traffic.Packets to network.received_packets.
- If flow_direction is ingress then mapped byt to network.received_bytes.
- If flow_direction is ingress then mapped Traffic.Bytes to network.received_bytes.
- If flow_direction is ingress then mapped bytes to network.received_bytes.
- If flow_direction is egress then mapped packets to network.sent_packets.
- If flow_direction is egress then mapped traffic.packets to network.sent_packets.
- If flow_direction is egress then mapped Traffic.Packets to network.sent_packets.
- If flow_direction is egress then mapped byt to network.sent_bytes.
- If flow_direction is egress then mapped Traffic.Bytes to network.sent_bytes.
- If flow_direction is egress then mapped bytes to network.sent_bytes.
2025-01-31 Enhancement:
- Changed mappings of Instance_id, instance_id and InstanceID from principal.cloud.project.id to principal.resource_ancestors.product_object_id.
- Changed mappings of Vpc_id and vpcID from principal.cloud.vpc.id to principal.resource.attribute.labels.
2025-01-13 Enhancement:
- Added a new Grok pattern to parse the unparsed logs.
2024-12-27 Enhancement:
- Added a Grok pattern to parse logs in proper format.
- Mapped protocol_code to additional.fields.
2024-12-20 Enhancement:
- Added a Grok pattern to parse the unparsed logs.
2024-12-05 Enhancement:
- Added Grok patterns to parse the unparsed logs.
- Mapped tgw-id, tgw-attachment-id, tgw-pair-attachment-id, packets-lost-no-route, packets-lost-blackhole, packets-lost-mtu-exceeded, packets-lost-ttl-expired, packets, start-time, end-time, and bytes to additional.fields.
- Mapped resource_type to principal.resource.resource_type.
- Mapped tgw_src_vpc_account_id to principal.user.userid.
- Mapped tgw_dst_vpc_account_id to target.user.userid.
- Mapped tgw_src_eni and tgw-src-az-id to principal.resource.attribute.labels.
- Mapped tgw-dst-eni and tgw-dst-az-id to target.resource.attribute.labels.
- Mapped tgw-src-subnet-id to principal.resource.attribute.labels.
- Mapped tgw-dst-subnet-id to target.resource.attribute.labels.
- Mapped tgw_src_vpc_id to principal.resource.product_object_id.
- Mapped tgw_dst_vpc_id to target.resource.product_object_id.
- Mapped type, flow_direction, and instance_id to about.resource.attribute.labels.
2024-10-30 Enhancement:
- Mapped Metadata.Product.version to metadata.product_version.
- Mapped cloud.zone to target.resource.attribute.cloud.availability_zone.
- Mapped cloud.provider to target.resource.attribute.cloud.environment.
- Mapped src_endpoint.port to principal.port.
- Mapped src_endpoint.ip to principal.ip.
- Mapped dst_endpoint.port to target.port.
- Mapped dst_endpoint.ip to target.ip.
- Mapped metadata.product.feature.name, metadata.profiles, metadata.version, cloud.account.uid, cloud.region, src_endpoint.interface_uid, src_endpoint.vpc_uid, src_endpoint.instance_uid, src_endpoint.subnet_uid to additional.fields.
- Mapped dst_endpoint.interface_uid, dst_endpoint.vpc_uid, dst_endpoint.instance_uid, and dst_endpoint.subnet_uid to additional.fields.
- Mapped connection_info.protocol_num to network.ip_protocol.
- Mapped connection_info.direction to network.direction.
- Mapped severity_id to security_result.severity.
- Mapped category_name to security_result.category_details.
- Mapped activity_name to metadata.product_event_type.
2024-10-01 Enhancement:
- Added support for new unparsed logs of type AWS_VPC_FLOW.
2024-07-31 Enhancement:
- Added support for JSON format logs.
2023-04-06 Enhancement - Mapped metadata.event_type to GENERIC_EVENT where both srcaddr and dstaddr is not present.
2022-10-18 Enhancement - Modified mapping for the value of following fields from additional.fields to about.resource.attribute.labels :
- interfaceId , packets , SubnetID , logStatus ,tcp_flags ,traffic_path ,start_time ,end_time, sublocation_id,sublocation_type ,pkt_dst_aws_service ,pkt_src_aws_service.
- Added grok pattern to parse logs in which destination_port might not be present.
2022-07-07 Enhancement - The newly ingested SYSLOG format logs have been parsed and handled using proper grok pattern.
2022-05-30 Enhancement - Modified the grok pattern to avoid incorrect mapping of UDM fields.
Mapped start_time, end_time, traffic_path, sublocation_id, sublocation_type, pkt_dst_aws_service and pkt_src_aws_service to additional.fields.
Added a new grok pattern to parse the logs of different format.
Mapped flow_direction to network.direction.
Mapped az_id to principal.cloud.availability_zone.
Mapped pkt_srcaddr, pkt_dstaddr to intermediary.ip.
2022-05-05 Enhancement - Updated mapping for the field accountId from principal.user.userid to metadata.product_log_id.
Mapped the field version to metadata.product_version.
Mapped the field end to metadata.ingested_timestamp.
Mapped action to security_result.action and security_result.action_details.
Mapped the field interfaceId, packets, SubnetID, logStatus, tcp_flags to additional.fields.