Google Professional Data Engineer Practice Test 64
Question 630
The data engineering team must correct this issue: A daily pipeline fails across multiple microservices, but logs cannot connect the initial import to the final BigQuery job. Which controlled engineering action is MOST appropriate?
- Alert on sustained lack of event-time progress and remediate the blocking stage.
- Propagate stable pipeline-run identifiers through logs, jobs, and metrics.
- Configure monitored assertions that block certification and alert accountable data owners.
- Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck.
Explanation
Correct Answer
B:Propagate stable pipeline-run identifiers through logs, jobs, and metrics. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: One failed sample run can be traced from source receipt to the failing transformation. End-to-end observability needs stable correlation identifiers and structured telemetry.
Incorrect Answers
A:Alert on sustained lack of event-time progress and remediate the blocking stage. This addresses a different situation: A stream's reported job state stays Running while the actual consumer watermark stops moving for twenty minutes. The current scenario instead calls for the more directly applicable engineering action: Propagate stable pipeline-run identifiers through logs, jobs, and metrics. The reason is that end-to-end observability needs stable correlation identifiers and structured telemetry.
C:Configure monitored assertions that block certification and alert accountable data owners. This addresses a different situation: An automated Dataform transform completes, but one critical assertion reports failed rows and no team is notified. The current scenario instead calls for the more directly applicable engineering action: Propagate stable pipeline-run identifiers through logs, jobs, and metrics. The reason is that end-to-end observability needs stable correlation identifiers and structured telemetry.
D:Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck. This addresses a different situation: A large BigQuery query fails with resources-exceeded errors and the operator sees only a generic dashboard red indicator. The current scenario instead calls for the more directly applicable engineering action: Propagate stable pipeline-run identifiers through logs, jobs, and metrics. The reason is that end-to-end observability needs stable correlation identifiers and structured telemetry.
Question 631
Before modifying the data platform, the team observes: A payment service must detect suspicious transaction patterns within seconds rather than after overnight aggregation. Which evidence should the engineer examine FIRST?
- Measure arrival rates, message ordering requirements, retention, and subscriber service objectives.
- Inspect producer IDs, ordering keys, concurrency, and downstream correctness rules.
- Inspect event timestamps, reference update cadence, join keys, and allowed staleness.
- Measure event arrival, detection SLA, event-time skew, and availability requirements.
Explanation
Correct Answer
D:Measure event arrival, detection SLA, event-time skew, and availability requirements. This evidence directly tests the uncertain part of the described system. Low-latency operational analytics need a streaming path with bounded end-to-end delay. A controlled response is: Use Pub/Sub and an appropriately configured Dataflow stream with an approved low-latency sink.
Incorrect Answers
A:Measure arrival rates, message ordering requirements, retention, and subscriber service objectives. This addresses a different situation: Thousands of store devices publish small events unpredictably, and downstream systems must process them independently without blocking publishers. The current scenario instead calls for the more directly applicable investigation: Measure event arrival, detection SLA, event-time skew, and availability requirements. The reason is that low-latency operational analytics need a streaming path with bounded end-to-end delay.
B:Inspect producer IDs, ordering keys, concurrency, and downstream correctness rules. This addresses a different situation: A product team requires per-customer event ordering but distributes all messages without a stable key and assumes total ordering across workers. The current scenario instead calls for the more directly applicable investigation: Measure event arrival, detection SLA, event-time skew, and availability requirements. The reason is that low-latency operational analytics need a streaming path with bounded end-to-end delay.
C:Inspect event timestamps, reference update cadence, join keys, and allowed staleness. This addresses a different situation: An IoT pipeline joins fast sensor events to slowly changing asset ownership records and occasionally labels readings with obsolete owners. The current scenario instead calls for the more directly applicable investigation: Measure event arrival, detection SLA, event-time skew, and availability requirements. The reason is that low-latency operational analytics need a streaming path with bounded end-to-end delay.
Question 632
A Google Cloud architecture review finds: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. Which principle BEST explains the underlying data-engineering risk?
- A managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
- Point-in-time recovery depends on supported continuous backups/log retention and tested restoration.
- AlloyDB may suit demanding PostgreSQL-compatible operational workloads when measured capabilities and costs fit.
- Retention and hold controls can protect governed objects against premature removal.
Explanation
Correct Answer
D:Retention and hold controls can protect governed objects against premature removal. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Review legal retention periods, bucket settings, object holds, and administrator rights. A focused corrective action is: Apply the approved Cloud Storage retention or hold mechanism with formal change control.
Incorrect Answers
A:A managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth. This addresses a different situation: An ecommerce service repeatedly looks up the same short-lived inventory recommendations and overwhelms its primary datastore during traffic peaks. The current scenario instead calls for the more directly applicable principle: Retention and hold controls can protect governed objects against premature removal. The reason is that retention and hold controls can protect governed objects against premature removal.
B:Point-in-time recovery depends on supported continuous backups/log retention and tested restoration. This addresses a different situation: A PostgreSQL operational service needs to restore state from immediately before a faulty data migration, not merely from the last weekly export. The current scenario instead calls for the more directly applicable principle: Retention and hold controls can protect governed objects against premature removal. The reason is that retention and hold controls can protect governed objects against premature removal.
C:AlloyDB may suit demanding PostgreSQL-compatible operational workloads when measured capabilities and costs fit. This addresses a different situation: A PostgreSQL-compatible application has intensive operational transactions plus complex analytical queries and wants compatible managed performance options. The current scenario instead calls for the more directly applicable principle: Retention and hold controls can protect governed objects against premature removal. The reason is that retention and hold controls can protect governed objects against premature removal.
Question 633
A Google Cloud data engineer is addressing: A reporting table is updated from multiple partners, and records arriving days late overwrite newer authoritative versions. Which TWO complementary actions should the team take? Select TWO answers.
- Implement version-aware merges with authoritative ordering and an auditable correction pathway.
- Use supported Dataflow recovery and replay procedures with independently verified sink idempotency.
- Examine event times, source priority, change sequence, and BigQuery merge logic.
- Require human-reviewed read-only dry runs and approved execution boundaries for generated queries.
- Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window.
Explanation
Correct Answers
A:Implement version-aware merges with authoritative ordering and an auditable correction pathway. This is the applicable controlled engineering response. Its complementary step is: Examine event times, source priority, change sequence, and BigQuery merge logic. Together they address: Data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
C:Examine event times, source priority, change sequence, and BigQuery merge logic. This is the applicable diagnostic investigation. Its complementary step is: Implement version-aware merges with authoritative ordering and an auditable correction pathway. Together they address: Data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
Incorrect Answers
B:Use supported Dataflow recovery and replay procedures with independently verified sink idempotency. This could be useful for another system: A six-hour streaming Dataflow job is relaunched after worker failure and loses uncommitted state when operators create a new pipeline without recovery planning. For this situation, the necessary paired decisions are to examine (Examine event times, source priority, change sequence, and BigQuery merge logic.) and to implement (Implement version-aware merges with authoritative ordering and an auditable correction pathway.).
D:Require human-reviewed read-only dry runs and approved execution boundaries for generated queries. This could be useful for another system: An analytics team uses LLM-generated BigQuery SQL and executes it immediately against production tables with write privileges. For this situation, the necessary paired decisions are to examine (Examine event times, source priority, change sequence, and BigQuery merge logic.) and to implement (Implement version-aware merges with authoritative ordering and an auditable correction pathway.).
E:Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window. This could be useful for another system: A payments stream retries messages after transient failures, causing duplicate warehouse revenue rows during replay. For this situation, the necessary paired decisions are to examine (Examine event times, source priority, change sequence, and BigQuery merge logic.) and to implement (Implement version-aware merges with authoritative ordering and an auditable correction pathway.).
Question 634
A Google Cloud data engineer is addressing: Daily vendor deliveries contain multipart files with duplicate names and changing schemas, making ingestion traceability unreliable. Which TWO complementary actions should the team take? Select TWO answers.
- Adopt versioned landing paths and idempotent manifest processing before transformation.
- Configure appropriate message retention or raw event archival for replay and recovery.
- Inspect object names, source timestamps, hash manifests, schemas, and duplicate deliveries.
- Use a scheduled batch processing workflow with timely validated delivery for monthly reporting.
- Implement versioned reference lookups or temporal enrichment with explicit validity periods.
Explanation
Correct Answers
A:Adopt versioned landing paths and idempotent manifest processing before transformation. This is the applicable controlled engineering response. Its complementary step is: Inspect object names, source timestamps, hash manifests, schemas, and duplicate deliveries. Together they address: Immutable landing identity and manifest metadata enable replay and operational reconciliation.
C:Inspect object names, source timestamps, hash manifests, schemas, and duplicate deliveries. This is the applicable diagnostic investigation. Its complementary step is: Adopt versioned landing paths and idempotent manifest processing before transformation. Together they address: Immutable landing identity and manifest metadata enable replay and operational reconciliation.
Incorrect Answers
B:Configure appropriate message retention or raw event archival for replay and recovery. This could be useful for another system: A vehicle telemetry stream might need replay after an outage, but source retention expires sooner than the required recovery window. For this situation, the necessary paired decisions are to examine (Inspect object names, source timestamps, hash manifests, schemas, and duplicate deliveries.) and to implement (Adopt versioned landing paths and idempotent manifest processing before transformation.).
D:Use a scheduled batch processing workflow with timely validated delivery for monthly reporting. This could be useful for another system: A monthly tax report is generated once per period, but architects propose a continuously running expensive streaming engine. For this situation, the necessary paired decisions are to examine (Inspect object names, source timestamps, hash manifests, schemas, and duplicate deliveries.) and to implement (Adopt versioned landing paths and idempotent manifest processing before transformation.).
E:Implement versioned reference lookups or temporal enrichment with explicit validity periods. This could be useful for another system: An IoT pipeline joins fast sensor events to slowly changing asset ownership records and occasionally labels readings with obsolete owners. For this situation, the necessary paired decisions are to examine (Inspect object names, source timestamps, hash manifests, schemas, and duplicate deliveries.) and to implement (Adopt versioned landing paths and idempotent manifest processing before transformation.).
Question 635
Before modifying the data platform, the team observes: A regulated finance team requires customer-managed keys for sensitive BigQuery tables and documented key revocation procedures. Which evidence should the engineer examine FIRST?
- Review dataset and table encryption settings, Cloud KMS key permissions, key location, and rotation policy.
- Examine Cloud Audit Logs configuration, data access log coverage, export job history, and retention.
- Inventory PII fields, consumer roles, retention policies, and approved de-identification requirements.
- Review contractual geographies, BigQuery dataset locations, Cloud Storage bucket regions, and transfer flows.
Explanation
Correct Answer
A:Review dataset and table encryption settings, Cloud KMS key permissions, key location, and rotation policy. This evidence directly tests the uncertain part of the described system. Customer-managed encryption keys introduce additional key access and availability dependencies that must be governed. A controlled response is: Create the approved regional KMS key and configure eligible BigQuery storage to use it with scoped service-agent access.
Incorrect Answers
B:Examine Cloud Audit Logs configuration, data access log coverage, export job history, and retention. This addresses a different situation: A compliance team cannot determine which identity exported a restricted BigQuery customer table last week. The current scenario instead calls for the more directly applicable investigation: Review dataset and table encryption settings, Cloud KMS key permissions, key location, and rotation policy. The reason is that customer-managed encryption keys introduce additional key access and availability dependencies that must be governed.
C:Inventory PII fields, consumer roles, retention policies, and approved de-identification requirements. This addresses a different situation: Customer support event feeds contain phone numbers and account identifiers, but most analysts require only behavioral aggregates. The current scenario instead calls for the more directly applicable investigation: Review dataset and table encryption settings, Cloud KMS key permissions, key location, and rotation policy. The reason is that customer-managed encryption keys introduce additional key access and availability dependencies that must be governed.
D:Review contractual geographies, BigQuery dataset locations, Cloud Storage bucket regions, and transfer flows. This addresses a different situation: A European customer contract restricts processing and storage to approved locations, while engineers intend to replicate datasets to another continent. The current scenario instead calls for the more directly applicable investigation: Review dataset and table encryption settings, Cloud KMS key permissions, key location, and rotation policy. The reason is that customer-managed encryption keys introduce additional key access and availability dependencies that must be governed.
Question 636
A Google Cloud data engineer is addressing: A data lake ingestion job repeatedly misses one daily source partition yet storage dashboards show only total object count. Which TWO complementary actions should the team take? Select TWO answers.
- Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories.
- Compare source schemas, quality rules, ingestion logs, and rejected rows.
- Implement per-source completeness checks with actionable missing-partition alerts.
- Review bucket usage, object ages, lineage references, recovery requirements, and storage cost.
- Inspect object locations, bucket IAM, table controls, and data classifications.
Explanation
Correct Answers
A:Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. This is the applicable diagnostic investigation. Its complementary step is: Implement per-source completeness checks with actionable missing-partition alerts. Together they address: Lake operational monitoring needs partition completeness and business-level freshness signals.
C:Implement per-source completeness checks with actionable missing-partition alerts. This is the applicable controlled engineering response. Its complementary step is: Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. Together they address: Lake operational monitoring needs partition completeness and business-level freshness signals.
Incorrect Answers
B:Compare source schemas, quality rules, ingestion logs, and rejected rows. This could be useful for another system: Multiple departments publish raw JSON to a shared lake with inconsistent field definitions that break downstream reusable tables. For this situation, the necessary paired decisions are to examine (Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories.) and to implement (Implement per-source completeness checks with actionable missing-partition alerts.).
D:Review bucket usage, object ages, lineage references, recovery requirements, and storage cost. This could be useful for another system: A lake accumulates experimental intermediate outputs that cost more than final retained datasets and lacks automated expiration. For this situation, the necessary paired decisions are to examine (Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories.) and to implement (Implement per-source completeness checks with actionable missing-partition alerts.).
E:Inspect object locations, bucket IAM, table controls, and data classifications. This could be useful for another system: A research lake contains both public scientific data and restricted patient samples under one bucket with unrestricted reader roles. For this situation, the necessary paired decisions are to examine (Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories.) and to implement (Implement per-source completeness checks with actionable missing-partition alerts.).
Question 637
After applying the change, the team re-examines this condition: A platform has steady high-volume SQL demand but is paying unpredictable per-query cost while finance requires capacity budgets. Which result BEST verifies the improvement?
- A representative report returns identical metrics while processing fewer billed bytes.
- The executive query meets its deadline while historic processing completes within its wider window.
- A simulated experiment surge does not violate the payment settlement processing deadline.
- The selected configuration meets throughput and documented budget targets on representative workloads.
Explanation
Correct Answer
D:The selected configuration meets throughput and documented budget targets on representative workloads. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Model an appropriate BigQuery Editions capacity reservation with planned commitments. Capacity pricing and reservations should be evaluated against measured utilization and service commitments.
Incorrect Answers
A:A representative report returns identical metrics while processing fewer billed bytes. This addresses a different situation: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. The current scenario instead calls for the more directly applicable verification result: The selected configuration meets throughput and documented budget targets on representative workloads. The reason is that capacity pricing and reservations should be evaluated against measured utilization and service commitments.
B:The executive query meets its deadline while historic processing completes within its wider window. This addresses a different situation: A same-day executive dashboard competes with a large nonurgent nightly historical rebuild. The current scenario instead calls for the more directly applicable verification result: The selected configuration meets throughput and documented budget targets on representative workloads. The reason is that capacity pricing and reservations should be evaluated against measured utilization and service commitments.
C:A simulated experiment surge does not violate the payment settlement processing deadline. This addresses a different situation: A payment streaming system is operationally critical, but monthly experimentation triggers heavy resource contention and delayed settlement events. The current scenario instead calls for the more directly applicable verification result: The selected configuration meets throughput and documented budget targets on representative workloads. The reason is that capacity pricing and reservations should be evaluated against measured utilization and service commitments.
Question 638
After applying the change, the team re-examines this condition: A data science team needs occasional huge feature-engineering runs but competes with a permanently reserved reporting workload. Which result BEST verifies the improvement?
- A representative report returns identical metrics while processing fewer billed bytes.
- A simulated experiment surge does not violate the payment settlement processing deadline.
- The feature run completes within its deadline without degrading protected operational reports.
- The selected configuration meets throughput and documented budget targets on representative workloads.
Explanation
Correct Answer
C:The feature run completes within its deadline without degrading protected operational reports. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Use a governed flexible or separate capacity allocation appropriate to the measured burst. Flexible capacity and assignment strategies can isolate occasional bursts without starving core reporting.
Incorrect Answers
A:A representative report returns identical metrics while processing fewer billed bytes. This addresses a different situation: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. The current scenario instead calls for the more directly applicable verification result: The feature run completes within its deadline without degrading protected operational reports. The reason is that flexible capacity and assignment strategies can isolate occasional bursts without starving core reporting.
B:A simulated experiment surge does not violate the payment settlement processing deadline. This addresses a different situation: A payment streaming system is operationally critical, but monthly experimentation triggers heavy resource contention and delayed settlement events. The current scenario instead calls for the more directly applicable verification result: The feature run completes within its deadline without degrading protected operational reports. The reason is that flexible capacity and assignment strategies can isolate occasional bursts without starving core reporting.
D:The selected configuration meets throughput and documented budget targets on representative workloads. This addresses a different situation: A platform has steady high-volume SQL demand but is paying unpredictable per-query cost while finance requires capacity budgets. The current scenario instead calls for the more directly applicable verification result: The feature run completes within its deadline without degrading protected operational reports. The reason is that flexible capacity and assignment strategies can isolate occasional bursts without starving core reporting.
Question 639
A Google Cloud architecture review finds: Data teams use Cloud Storage for open formats and BigQuery for SQL, but each engine applies incompatible permissions to the same sensitive records. Which principle BEST explains the underlying data-engineering risk?
- Multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
- Bigtable is appropriate for certain high-throughput low-latency key-oriented workloads when row-key design is sound.
- Federated data platform governance balances domain ownership with shared discovery and interoperability policies.
- Federated governance needs clear decision rights, shared policies, and local stewardship.
Explanation
Correct Answer
A:Multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Review BigLake table grants, underlying bucket permissions, identities, and supported engines. A focused corrective action is: Implement a governed lakehouse catalog and role model that avoids bypass through raw object access.
Incorrect Answers
B:Bigtable is appropriate for certain high-throughput low-latency key-oriented workloads when row-key design is sound. This addresses a different situation: A logistics app needs millisecond lookups for enormous numbers of sparse sensor rows keyed by device and time, with no requirement for SQL joins. The current scenario instead calls for the more directly applicable principle: Multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
C:Federated data platform governance balances domain ownership with shared discovery and interoperability policies. This addresses a different situation: Finance and logistics teams publish data independently, but a central team imposes one schema that ignores both domains' definitions. The current scenario instead calls for the more directly applicable principle: Multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
D:Federated governance needs clear decision rights, shared policies, and local stewardship. This addresses a different situation: A global enterprise distributes data ownership to regional teams but needs one standard for naming, retention, and access requests. The current scenario instead calls for the more directly applicable principle: Multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
Question 640
After applying the change, the team re-examines this condition: A production model receives categorical values in a format different from the BigQuery ML training transformations. Which result BEST verifies the improvement?
- A held-out set shows acceptable fraud detection without overwhelming legitimate transactions.
- The same test record produces equivalent engineered features in training and serving paths.
- A prior approved model can be reproduced or identified for rollback and comparison.
- A future-period evaluation remains credible without using post-outcome information.
Explanation
Correct Answer
B:The same test record produces equivalent engineered features in training and serving paths. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Version reusable transformations and validate feature parity between training and serving. Training-serving feature consistency is essential for reliable inference quality.
Incorrect Answers
A:A held-out set shows acceptable fraud detection without overwhelming legitimate transactions. This addresses a different situation: A fraud model reports 99 percent accuracy on data where only one in a thousand transactions is fraudulent. The current scenario instead calls for the more directly applicable verification result: The same test record produces equivalent engineered features in training and serving paths. The reason is that training-serving feature consistency is essential for reliable inference quality.
C:A prior approved model can be reproduced or identified for rollback and comparison. This addresses a different situation: A data scientist overwrites a BigQuery ML model each week and has no record of which training window produced the current predictions. The current scenario instead calls for the more directly applicable verification result: The same test record produces equivalent engineered features in training and serving paths. The reason is that training-serving feature consistency is essential for reliable inference quality.
D:A future-period evaluation remains credible without using post-outcome information. This addresses a different situation: A churn model trains on a cancellation timestamp that becomes known only after the customer leaves, producing unrealistic validation accuracy. The current scenario instead calls for the more directly applicable verification result: The same test record produces equivalent engineered features in training and serving paths. The reason is that training-serving feature consistency is essential for reliable inference quality.