Skip to content

Commit ba90ff3

Browse files
authored
[O365_metrics]Split and refactor other data streams. (elastic#12456)
* Split and refactor data streams
1 parent 38038c3 commit ba90ff3

File tree

68 files changed

+2415
-1326
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

68 files changed

+2415
-1326
lines changed

.github/CODEOWNERS

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -461,14 +461,15 @@
461461
/packages/o365_metrics @elastic/obs-infraobs-integrations @elastic/security-service-integrations
462462
/packages/o365_metrics/data_stream/active_users @elastic/obs-infraobs-integrations
463463
/packages/o365_metrics/data_stream/groups_activity_group_detail @elastic/security-service-integrations
464-
/packages/o365_metrics/data_stream/mailbox_usage @elastic/obs-infraobs-integrations
464+
/packages/o365_metrics/data_stream/mailbox_usage_detail @elastic/obs-infraobs-integrations
465+
/packages/o365_metrics/data_stream/mailbox_usage_quota_status @elastic/obs-infraobs-integrations
465466
/packages/o365_metrics/data_stream/onedrive_usage @elastic/obs-infraobs-integrations
466467
/packages/o365_metrics/data_stream/onedrive_usage_account_detail @elastic/security-service-integrations
467468
/packages/o365_metrics/data_stream/outlook_activity @elastic/obs-infraobs-integrations
468-
/packages/o365_metrics/data_stream/outlook_app_usage @elastic/obs-infraobs-integrations
469+
/packages/o365_metrics/data_stream/outlook_app_usage_version_counts @elastic/obs-infraobs-integrations
469470
/packages/o365_metrics/data_stream/sharepoint_site_usage @elastic/obs-infraobs-integrations
470471
/packages/o365_metrics/data_stream/teams_device_usage_user_counts @elastic/obs-infraobs-integrations
471472
/packages/o365_metrics/data_stream/teams_user_activity_user_counts @elastic/obs-infraobs-integrations
472473
/packages/o365_metrics/data_stream/teams_user_activity_user_detail @elastic/security-service-integrations
473474
/packages/o365_metrics/data_stream/viva_engage_groups_activity_group_detail @elastic/security-service-integrations
474-
/packages/o365_metrics/data_stream/yammer_device_usage @elastic/obs-infraobs-integrations
475+
/packages/o365_metrics/data_stream/viva_engage_device_usage_user_counts @elastic/obs-infraobs-integrations

packages/o365_metrics/_dev/build/docs/README.md

Lines changed: 36 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -15,16 +15,16 @@ Following Microsoft 365 Graph Reports can be collected by Microsoft Office 365 M
1515
| [OneDrive Usage File Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/onedrive-for-business-usage-ww?view=o365-worldwide) | [reportRoot: getOneDriveUsageFileCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getonedriveusagefilecounts?view=graph-rest-1.0&tabs=http) | Office 365 One Drive Usage metrics | `Period`-based |
1616
| [OneDrive Usage Storage](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/onedrive-for-business-usage-ww?view=o365-worldwide) | [reportRoot: getOneDriveUsageStorage](https://learn.microsoft.com/en-us/graph/api/reportroot-getonedriveusagestorage?view=graph-rest-1.0&tabs=http) | Office 365 One Drive Usage metrics | `Period`-based |
1717
| [Outlook Activity Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/email-activity-ww?view=o365-worldwide) | [reportRoot: getEmailActivityCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getemailactivitycounts?view=graph-rest-1.0&tabs=http) | Office 365 Outlook Activity metrics | `Period`-based |
18-
| [Outlook App Usage Version User Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/email-apps-usage-ww?view=o365-worldwide) | [reportRoot: getEmailAppUsageVersionsUserCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getemailappusageversionsusercounts?view=graph-rest-1.0&tabs=http) | Office 365 Outlook App Usage metrics | `Period`-based |
19-
| [Outlook Mailbox Usage Quota Status Mailbox Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/mailbox-usage?view=o365-worldwide) | [reportRoot: getMailboxUsageQuotaStatusMailboxCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getmailboxusagequotastatusmailboxcounts?view=graph-rest-1.0&tabs=http) | O365 mailbox quota status and mailbox usage detail metrics | `Period`-based |
20-
| [Outlook Mailbox Usage Mailbox Detail](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/mailbox-usage?view=o365-worldwide) | [reportRoot: getMailboxUsageDetail](https://learn.microsoft.com/en-us/graph/api/reportroot-getmailboxusagedetail?view=graph-rest-1.0&tabs=http) | O365 mailbox quota status and mailbox usage detail metrics | `Period`-based |
18+
| [Outlook App Usage Version Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/email-apps-usage-ww?view=o365-worldwide) | [reportRoot: getEmailAppUsageVersionsUserCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getemailappusageversionsusercounts?view=graph-rest-1.0&tabs=http) | Microsoft 365 Outlook App Usage Version Counts metrics | `Period`-based |
19+
| [Outlook Mailbox Usage Quota Status Mailbox Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/mailbox-usage?view=o365-worldwide) | [reportRoot: getMailboxUsageQuotaStatusMailboxCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getmailboxusagequotastatusmailboxcounts?view=graph-rest-1.0&tabs=http) | Microsoft 365 mailbox usage quota status metrics | `Period`-based |
20+
| [Outlook Mailbox Usage Detail](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/mailbox-usage?view=o365-worldwide) | [reportRoot: getMailboxUsageDetail](https://learn.microsoft.com/en-us/graph/api/reportroot-getmailboxusagedetail?view=graph-rest-1.0&tabs=http) | Microsoft 365 mailbox usage detail metrics | `Period`-based |
2121
| [SharePoint Site Usage Storage](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/sharepoint-site-usage-ww?view=o365-worldwide) | [reportRoot: getSharePointSiteUsageStorage](https://learn.microsoft.com/en-us/graph/api/reportroot-getsharepointsiteusagestorage?view=graph-rest-1.0&tabs=http) | Office 365 Sharepoint Site Usage metrics | `Period`-based |
2222
| [SharePoint Site Usage Site Detail](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/sharepoint-site-usage-ww?view=o365-worldwide) | [reportRoot: getSharePointSiteUsageDetail](https://learn.microsoft.com/en-us/graph/api/reportroot-getsharepointsiteusagedetail?view=graph-rest-1.0&tabs=http) | Office 365 Sharepoint Site Usage metrics | `Period`-based |
23-
| [Teams Device Usage User Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/microsoft-teams-device-usage-preview?view=o365-worldwide) | [reportRoot: getTeamsDeviceUsageUserCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getteamsdeviceusageusercounts?view=graph-rest-1.0&tabs=http) | Office 365 Teams Device Usage User Counts metrics | `Period`-based |
24-
| [Teams User Activity User Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/microsoft-teams-user-activity-preview?view=o365-worldwide) | [reportRoot: getTeamsUserActivityUserCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getteamsuseractivityusercounts?view=graph-rest-1.0&tabs=http) | Office 365 Teams User Activity User Counts metrics | `Period`-based |
23+
| [Teams Device Usage User Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/microsoft-teams-device-usage-preview?view=o365-worldwide) | [reportRoot: getTeamsDeviceUsageUserCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getteamsdeviceusageusercounts?view=graph-rest-1.0&tabs=http) | Microsoft 365 Teams Device Usage User Counts metrics | `Period`-based |
24+
| [Teams User Activity User Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/microsoft-teams-user-activity-preview?view=o365-worldwide) | [reportRoot: getTeamsUserActivityUserCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getteamsuseractivityusercounts?view=graph-rest-1.0&tabs=http) | Microsoft 365 Teams User Activity User Counts metrics | `Period`-based |
2525
| [Teams User Activity User Detail](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/microsoft-teams-user-activity-preview?view=o365-worldwide) | [reportRoot: getTeamsUserActivityUserDetail](https://learn.microsoft.com/en-us/graph/api/reportroot-getteamsuseractivityuserdetail?view=graph-rest-1.0&tabs=http) | Microsoft 365 Teams User Activity User Detail | `Day`-based |
2626
| [Viva Engage Groups Activity Group Detail](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/viva-engage-groups-activity-report-ww?view=o365-worldwide) | [reportRoot: getYammerGroupsActivityDetail](https://learn.microsoft.com/en-us/graph/api/reportroot-getyammergroupsactivitydetail?view=graph-rest-1.0&tabs=http) | Microsoft 365 Viva Engage Groups Activity | `Day`-based |
27-
| [Yammer Device Usage User Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/viva-engage-device-usage-report-ww?view=o365-worldwide) | [reportRoot: getYammerDeviceUsageUserCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getyammerdeviceusageusercounts?view=graph-rest-1.0&tabs=http) | Office 365 Yammer Device Usage metrics | `Period`-based |
27+
| [Viva Enageg Device Usage User Counts](https://learn.microsoft.com/en-us/microsoft-365/admin/activity-reports/viva-engage-device-usage-report-ww?view=o365-worldwide) | [reportRoot: getYammerDeviceUsageUserCounts](https://learn.microsoft.com/en-us/graph/api/reportroot-getyammerdeviceusageusercounts?view=graph-rest-1.0&tabs=http) | Microsoft 365 Viva Engage Device Usage User Counts metrics | `Period`-based |
2828

2929
## Setup
3030

@@ -90,7 +90,7 @@ By default for all Microsoft 365 usage reports, the user names, emails, group, o
9090

9191
## Metrics
9292

93-
Uses the Office 365 Graph API to retrieve metrics from Office 365.
93+
Uses the Microsoft 365 Graph API to retrieve metrics from Microsoft 365.
9494

9595
### Active Users
9696

@@ -102,15 +102,29 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
102102

103103
{{fields "active_users"}}
104104

105-
### Mailbox Usage
105+
### Mailbox Usage Quota Status
106106

107-
{{event "mailbox_usage"}}
107+
Get details about Mailbox Usage Quota Status [Microsoft Graph API](https://learn.microsoft.com/en-us/graph/api/reportroot-getmailboxusagequotastatusmailboxcounts?view=graph-rest-1.0&tabs=http).
108+
109+
{{event "mailbox_usage_quota_status"}}
110+
111+
**ECS Field Reference**
112+
113+
Please refer to the following [document](https://www.elastic.co/guide/en/ecs/current/ecs-field-reference.html) for detailed information on ECS fields.
114+
115+
{{fields "mailbox_usage_quota_status"}}
116+
117+
### Mailbox Usage Detail
118+
119+
Get details about Mailbox Usage Detail [Microsoft Graph API](https://learn.microsoft.com/en-us/graph/api/reportroot-getmailboxusagedetail?view=graph-rest-1.0&tabs=http).
120+
121+
{{event "mailbox_usage_detail"}}
108122

109123
**ECS Field Reference**
110124

111125
Please refer to the following [document](https://www.elastic.co/guide/en/ecs/current/ecs-field-reference.html) for detailed information on ECS fields.
112126

113-
{{fields "mailbox_usage"}}
127+
{{fields "mailbox_usage_detail"}}
114128

115129
### Microsoft 365 Groups Activity Group Detail
116130

@@ -148,6 +162,8 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
148162

149163
### Outlook Activity
150164

165+
Get details about Outlook Activity from [Microsoft Graph API](https://learn.microsoft.com/en-us/graph/api/reportroot-getemailactivitycounts?view=graph-rest-1.0&tabs=http).
166+
151167
{{event "outlook_activity"}}
152168

153169
**ECS Field Reference**
@@ -156,15 +172,17 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
156172

157173
{{fields "outlook_activity"}}
158174

159-
### Outlook App Usage
175+
### Outlook App Usage Version Counts
176+
177+
Get details about Microsoft Outlook App Usage Version Counts from [Microsoft Graph API](https://learn.microsoft.com/en-us/graph/api/reportroot-getemailappusageversionsusercounts?view=graph-rest-1.0&tabs=http).
160178

161-
{{event "outlook_app_usage"}}
179+
{{event "outlook_app_usage_version_counts"}}
162180

163181
**ECS Field Reference**
164182

165183
Please refer to the following [document](https://www.elastic.co/guide/en/ecs/current/ecs-field-reference.html) for detailed information on ECS fields.
166184

167-
{{fields "outlook_app_usage"}}
185+
{{fields "outlook_app_usage_version_counts"}}
168186

169187
### SharePoint Site Usage
170188

@@ -210,15 +228,17 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
210228

211229
{{fields "viva_engage_groups_activity_group_detail"}}
212230

213-
### Yammer Device Usage
231+
### Viva Engage Device Usage User Counts
232+
233+
Get details about Yammer device usage from [Microsoft Graph API](https://learn.microsoft.com/en-us/graph/api/reportroot-getyammerdeviceusageusercounts?view=graph-rest-1.0&tabs=http).
214234

215-
{{event "yammer_device_usage"}}
235+
{{event "viva_engage_device_usage_user_counts"}}
216236

217237
**ECS Field Reference**
218238

219239
Please refer to the following [document](https://www.elastic.co/guide/en/ecs/current/ecs-field-reference.html) for detailed information on ECS fields.
220240

221-
{{fields "yammer_device_usage"}}
241+
{{fields "viva_engage_device_usage_user_counts"}}
222242

223243

224244
### Teams Device Usage User Counts

packages/o365_metrics/changelog.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,9 @@
44
- description: Add `teams_device_usage_user_counts` data stream.
55
type: enhancement
66
link: https://github.com/elastic/integrations/pull/12218
7+
- description: Split data stream `mailbox_usage` into `mailbox_usage_detail` and `mailbox_usage_quota_status_mailbox_counts`, and refactor other datastreams.
8+
type: bugfix
9+
link: https://github.com/elastic/integrations/pull/12456
710
- version: "0.3.0"
811
changes:
912
- description: Add `groups_activity_group_detail`, `onedrive_usage_account_detail`, `teams_user_activity_user_detail`, and `viva_engage_groups_activity_group_detail` data streams.

packages/o365_metrics/data_stream/mailbox_usage/_dev/test/pipeline/test-mailbox-quota-status.json

Lines changed: 0 additions & 9 deletions
This file was deleted.

packages/o365_metrics/data_stream/mailbox_usage/_dev/test/pipeline/test-mailbox-quota-status.json-expected.json

Lines changed: 0 additions & 41 deletions
This file was deleted.

packages/o365_metrics/data_stream/mailbox_usage/_dev/test/pipeline/test-mailbox-usage-detail.json-expected.json

Lines changed: 0 additions & 49 deletions
This file was deleted.

0 commit comments

Comments
 (0)