BigQuery Logging and Monitoring Google Professional Data Engineer GCP
- use Cloud Monitoring to monitor BigQuery project:
- Display the metrics collected by Cloud Monitoring in own charts and dashboards.
- Create an alert for any thresholds.
Useful Metrics –
| Name | Units |
| Scanned bytes | Bytes per minute |
| Scanned bytes billed | Bytes per minute |
| Query time – 5th percentile – 50th percentile – 95th percentile – 99th percentile |
seconds |
| Slots allocated | slots |
| Slots allocated by job type | slots |
| Slots available | slots |
| Stored bytes | Bytes |
| Tables | Tables |
| Uploaded billed bytes | Bytes per minute |
| Uploaded bytes | Bytes per minute |
| Uploaded rows | Rows per minute |
- Use Cloud Audit Logs for audit log messages
- BigQuery service has 3 distinct messages:
- AuditData
- BigQueryAuditMetadata
- AuditLog
- Go to the Logs Viewer page in the Cloud Console for viewing logs for policy tag events
Google Professional Data Engineer (GCP) Free Practice TestTake a Quiz
