Google Professional Data Engineer Practice Test 43
Question 420
Before modifying the data platform, the team observes: A finance warehouse needs recoverable reporting after regional disruption but keeps its only critical dataset in one region. Which evidence should the engineer examine FIRST?
- Inspect dataset locations, backup/copy capabilities, recovery targets, and permitted residency.
- Inspect source retention, worker state, destination location, regional permissions, and documented steps.
- Review primary and replica roles, consistency modes, transaction commit paths, and failover configuration.
- Review availability configuration, application connection recovery, backups, and zone dependencies.
Explanation
Correct Answer
A:Inspect dataset locations, backup/copy capabilities, recovery targets, and permitted residency. This evidence directly tests the uncertain part of the described system. Analytical recovery requires independently retained copies and known restore procedures that meet policy. A controlled response is: Design and test a compatible cross-location recovery approach consistent with regulation.
Incorrect Answers
B:Inspect source retention, worker state, destination location, regional permissions, and documented steps. This addresses a different situation: A critical Pub/Sub-to-warehouse flow has a secondary-region deployment template but no retained state, failover routing, or test exercise. The current scenario instead calls for the more directly applicable investigation: Inspect dataset locations, backup/copy capabilities, recovery targets, and permitted residency. The reason is that analytical recovery requires independently retained copies and known restore procedures that meet policy.
C:Review primary and replica roles, consistency modes, transaction commit paths, and failover configuration. This addresses a different situation: An application routes financial writes to a stale read replica after primary failure, returning success before records are durably committed. The current scenario instead calls for the more directly applicable investigation: Inspect dataset locations, backup/copy capabilities, recovery targets, and permitted residency. The reason is that analytical recovery requires independently retained copies and known restore procedures that meet policy.
D:Review availability configuration, application connection recovery, backups, and zone dependencies. This addresses a different situation: A production relational data source resides on a single-zone Cloud SQL instance and a zone outage stops all ingestion. The current scenario instead calls for the more directly applicable investigation: Inspect dataset locations, backup/copy capabilities, recovery targets, and permitted residency. The reason is that analytical recovery requires independently retained copies and known restore procedures that meet policy.
Question 421
After applying the change, the team re-examines this condition: Analysts may inspect product transactions but only a small fraud group may see a sensitive risk score in the same table. Which result BEST verifies the improvement?
- An attempted development-table deletion cannot affect the production reporting dataset.
- The pipeline succeeds without personal credentials and cannot read an unrelated restricted source.
- A standard analyst queries allowed columns but is denied the tagged risk-score column.
- A sampled downstream query shows usable aggregates without exposing original phone numbers.
Explanation
Correct Answer
C:A standard analyst queries allowed columns but is denied the tagged risk-score column. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Apply approved column policy tags and corresponding fine-grained access controls. Column-level access policies can restrict sensitive BigQuery fields independently of broad table query rights.
Incorrect Answers
A:An attempted development-table deletion cannot affect the production reporting dataset. This addresses a different situation: Developers test destructive transformations against the same production dataset used for regulatory reporting. The current scenario instead calls for the more directly applicable verification result: A standard analyst queries allowed columns but is denied the tagged risk-score column. The reason is that column-level access policies can restrict sensitive BigQuery fields independently of broad table query rights.
B:The pipeline succeeds without personal credentials and cannot read an unrelated restricted source. This addresses a different situation: A Dataflow job in a processing project reads raw data from an ingestion project but uses a broad human administrator credential. The current scenario instead calls for the more directly applicable verification result: A standard analyst queries allowed columns but is denied the tagged risk-score column. The reason is that column-level access policies can restrict sensitive BigQuery fields independently of broad table query rights.
D:A sampled downstream query shows usable aggregates without exposing original phone numbers. This addresses a different situation: Customer support event feeds contain phone numbers and account identifiers, but most analysts require only behavioral aggregates. The current scenario instead calls for the more directly applicable verification result: A standard analyst queries allowed columns but is denied the tagged risk-score column. The reason is that column-level access policies can restrict sensitive BigQuery fields independently of broad table query rights.
Question 422
A Google Cloud architecture review finds: A platform has existing Kafka producers and needs to introduce cloud analytics without rewriting every producer immediately. Which principle BEST explains the underlying data-engineering risk?
- Ingestion should use explicit schemas where data semantics cannot be inferred reliably.
- Integration choice should preserve existing event semantics while decoupling cloud consumers.
- Throughput monitoring and correctly configured autoscaling help manage sustained stream backlogs.
- Event-driven loading needs a clear object-finalization signal and idempotent run identity.
Explanation
Correct Answer
B:Integration choice should preserve existing event semantics while decoupling cloud consumers. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect Kafka topic retention, schema contracts, network access, and bridge/connector support. A focused corrective action is: Adopt a supported Kafka-to-Google Cloud ingestion connector or bridge with measured delivery guarantees.
Incorrect Answers
A:Ingestion should use explicit schemas where data semantics cannot be inferred reliably. This addresses a different situation: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. The current scenario instead calls for the more directly applicable principle: Integration choice should preserve existing event semantics while decoupling cloud consumers. The reason is that integration choice should preserve existing event semantics while decoupling cloud consumers.
C:Throughput monitoring and correctly configured autoscaling help manage sustained stream backlogs. This addresses a different situation: During a marketing campaign, Pub/Sub backlog grows and Dataflow workers remain fixed far below incoming throughput. The current scenario instead calls for the more directly applicable principle: Integration choice should preserve existing event semantics while decoupling cloud consumers. The reason is that integration choice should preserve existing event semantics while decoupling cloud consumers.
D:Event-driven loading needs a clear object-finalization signal and idempotent run identity. This addresses a different situation: A pipeline should start only after a new approved object lands in a bucket, but currently polls every minute and processes partially copied files. The current scenario instead calls for the more directly applicable principle: Integration choice should preserve existing event semantics while decoupling cloud consumers. The reason is that integration choice should preserve existing event semantics while decoupling cloud consumers.
Question 423
After applying the change, the team re-examines this condition: A European customer contract restricts processing and storage to approved locations, while engineers intend to replicate datasets to another continent. Which result BEST verifies the improvement?
- Audited processing and copies remain in permitted regions throughout the full pipeline.
- A standard analyst queries allowed columns but is denied the tagged risk-score column.
- A test identity queries the authorized dataset but cannot read a separate payroll dataset.
- A test project cannot create prohibited resources while approved deployment patterns still work.
Explanation
Correct Answer
A:Audited processing and copies remain in permitted regions throughout the full pipeline. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Select compliant regional resources and constrain replication, jobs, and exports to approved locations. Data residency requirements must govern dataset locations and every replication or processing path.
Incorrect Answers
B:A standard analyst queries allowed columns but is denied the tagged risk-score column. This addresses a different situation: Analysts may inspect product transactions but only a small fraud group may see a sensitive risk score in the same table. The current scenario instead calls for the more directly applicable verification result: Audited processing and copies remain in permitted regions throughout the full pipeline. The reason is that data residency requirements must govern dataset locations and every replication or processing path.
C:A test identity queries the authorized dataset but cannot read a separate payroll dataset. This addresses a different situation: An analytics contractor needs to query one approved sales dataset, but the administrator proposes granting project-wide BigQuery Admin privileges. The current scenario instead calls for the more directly applicable verification result: Audited processing and copies remain in permitted regions throughout the full pipeline. The reason is that data residency requirements must govern dataset locations and every replication or processing path.
D:A test project cannot create prohibited resources while approved deployment patterns still work. This addresses a different situation: Several developer projects can create external IP resources and unrestricted service-account keys even though the organization prohibits them. The current scenario instead calls for the more directly applicable verification result: Audited processing and copies remain in permitted regions throughout the full pipeline. The reason is that data residency requirements must govern dataset locations and every replication or processing path.
Question 424
A Google Cloud data engineer is addressing: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. Which TWO complementary actions should the team take? Select TWO answers.
- Inspect scheduled-query owner, credential scope, destination permissions, and alert routing.
- Use a suitable Google Cloud Workflows definition for the small stateful service chain.
- Inspect scheduler overlap, destination write disposition, backfill ranges, and task locks.
- Implement a governed backfill workflow with bounded concurrent writes and reconciliation.
- Configure separate release workflows and narrowly scoped production invocation identities.
Explanation
Correct Answers
C:Inspect scheduler overlap, destination write disposition, backfill ranges, and task locks. This is the applicable diagnostic investigation. Its complementary step is: Implement a governed backfill workflow with bounded concurrent writes and reconciliation. Together they address: Backfill orchestration needs controlled concurrency and partition-level change coordination.
D:Implement a governed backfill workflow with bounded concurrent writes and reconciliation. This is the applicable controlled engineering response. Its complementary step is: Inspect scheduler overlap, destination write disposition, backfill ranges, and task locks. Together they address: Backfill orchestration needs controlled concurrency and partition-level change coordination.
Incorrect Answers
A:Inspect scheduled-query owner, credential scope, destination permissions, and alert routing. This could be useful for another system: A recurring transformation runs under the credentials of a departed analyst and begins failing when the account is disabled. For this situation, the necessary paired decisions are to examine (Inspect scheduler overlap, destination write disposition, backfill ranges, and task locks.) and to implement (Implement a governed backfill workflow with bounded concurrent writes and reconciliation.).
B:Use a suitable Google Cloud Workflows definition for the small stateful service chain. This could be useful for another system: A lightweight pipeline calls several managed service APIs in order with retry rules, but the team proposes maintaining an entire Airflow deployment for one request chain. For this situation, the necessary paired decisions are to examine (Inspect scheduler overlap, destination write disposition, backfill ranges, and task locks.) and to implement (Implement a governed backfill workflow with bounded concurrent writes and reconciliation.).
E:Configure separate release workflows and narrowly scoped production invocation identities. This could be useful for another system: A team builds new SQL models in a development workspace but schedules them against production datasets using the same credentials. For this situation, the necessary paired decisions are to examine (Inspect scheduler overlap, destination write disposition, backfill ranges, and task locks.) and to implement (Implement a governed backfill workflow with bounded concurrent writes and reconciliation.).
Question 425
A design review evaluates this situation: A payment service must detect suspicious transaction patterns within seconds rather than after overnight aggregation. Which shortcut should the team MOST specifically avoid?
- Overwrite the same raw filename every day and delete all prior manifests.
- Retry every HTTP 429 immediately at unlimited concurrency until the service accepts it.
- Make every device wait synchronously for all analytics consumers before accepting an event.
- Depend only on a once-daily scheduled CSV import for second-level response requirements.
Explanation
Correct Answer
D:Depend only on a once-daily scheduled CSV import for second-level response requirements. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Use Pub/Sub and an appropriately configured Dataflow stream with an approved low-latency sink. Why: Low-latency operational analytics need a streaming path with bounded end-to-end delay.
Incorrect Answers
A:Overwrite the same raw filename every day and delete all prior manifests. This addresses a different situation: Daily vendor deliveries contain multipart files with duplicate names and changing schemas, making ingestion traceability unreliable. The current scenario instead calls for the more directly applicable unsafe shortcut: Depend only on a once-daily scheduled CSV import for second-level response requirements. The reason is that low-latency operational analytics need a streaming path with bounded end-to-end delay.
B:Retry every HTTP 429 immediately at unlimited concurrency until the service accepts it. This addresses a different situation: A customer-relationship API imposes quotas, but ingestion code launches thousands of concurrent requests during a nightly backfill. The current scenario instead calls for the more directly applicable unsafe shortcut: Depend only on a once-daily scheduled CSV import for second-level response requirements. The reason is that low-latency operational analytics need a streaming path with bounded end-to-end delay.
C:Make every device wait synchronously for all analytics consumers before accepting an event. This addresses a different situation: Thousands of store devices publish small events unpredictably, and downstream systems must process them independently without blocking publishers. The current scenario instead calls for the more directly applicable unsafe shortcut: Depend only on a once-daily scheduled CSV import for second-level response requirements. The reason is that low-latency operational analytics need a streaming path with bounded end-to-end delay.
Question 426
A Google Cloud data engineer is addressing: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. Which TWO complementary actions should the team take? Select TWO answers.
- Review object access frequency, retention, retrieval cost, and lifecycle rules.
- Inspect per-stage parallelism, worker utilization, input sharding, and elapsed time.
- Inspect Dataproc CPU usage, YARN metrics, cluster autoscaling settings, and job boundaries.
- Inspect BigQuery job statistics, query projections, filters, and data partitions.
- Rewrite queries to project required fields and prune partitions with cost monitoring.
Explanation
Correct Answers
D:Inspect BigQuery job statistics, query projections, filters, and data partitions. This is the applicable diagnostic investigation. Its complementary step is: Rewrite queries to project required fields and prune partitions with cost monitoring. Together they address: Query cost control starts with bytes processed, filters, and selecting only required columns.
E:Rewrite queries to project required fields and prune partitions with cost monitoring. This is the applicable controlled engineering response. Its complementary step is: Inspect BigQuery job statistics, query projections, filters, and data partitions. Together they address: Query cost control starts with bytes processed, filters, and selecting only required columns.
Incorrect Answers
A:Review object access frequency, retention, retrieval cost, and lifecycle rules. This could be useful for another system: A media archive changes every object to the coldest storage class even though analysts read recent objects daily. For this situation, the necessary paired decisions are to examine (Inspect BigQuery job statistics, query projections, filters, and data partitions.) and to implement (Rewrite queries to project required fields and prune partitions with cost monitoring.).
B:Inspect per-stage parallelism, worker utilization, input sharding, and elapsed time. This could be useful for another system: A Dataflow batch pipeline processes a few large files using hundreds of workers while bottlenecked on one serialized source stage. For this situation, the necessary paired decisions are to examine (Inspect BigQuery job statistics, query projections, filters, and data partitions.) and to implement (Rewrite queries to project required fields and prune partitions with cost monitoring.).
C:Inspect Dataproc CPU usage, YARN metrics, cluster autoscaling settings, and job boundaries. This could be useful for another system: A large Spark cluster remains at peak worker count during long idle stages because autoscaling is disabled. For this situation, the necessary paired decisions are to examine (Inspect BigQuery job statistics, query projections, filters, and data partitions.) and to implement (Rewrite queries to project required fields and prune partitions with cost monitoring.).
Question 427
A Google Cloud architecture review finds: A product team requires per-customer event ordering but distributes all messages without a stable key and assumes total ordering across workers. Which principle BEST explains the underlying data-engineering risk?
- Ordering requirements must be explicit, scoped, and supported by the message architecture.
- Low-latency operational analytics need a streaming path with bounded end-to-end delay.
- Decoupled messaging can buffer variable event rates and isolate independent consumers.
- Ingestion networking and encryption must align with connectivity and trust boundaries.
Explanation
Correct Answer
A:Ordering requirements must be explicit, scoped, and supported by the message architecture. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect producer IDs, ordering keys, concurrency, and downstream correctness rules. A focused corrective action is: Assign a stable entity key and configure supported ordered delivery or downstream sequence reconciliation.
Incorrect Answers
B:Low-latency operational analytics need a streaming path with bounded end-to-end delay. This addresses a different situation: A payment service must detect suspicious transaction patterns within seconds rather than after overnight aggregation. The current scenario instead calls for the more directly applicable principle: Ordering requirements must be explicit, scoped, and supported by the message architecture. The reason is that ordering requirements must be explicit, scoped, and supported by the message architecture.
C:Decoupled messaging can buffer variable event rates and isolate independent consumers. This addresses a different situation: Thousands of store devices publish small events unpredictably, and downstream systems must process them independently without blocking publishers. The current scenario instead calls for the more directly applicable principle: Ordering requirements must be explicit, scoped, and supported by the message architecture. The reason is that ordering requirements must be explicit, scoped, and supported by the message architecture.
D:Ingestion networking and encryption must align with connectivity and trust boundaries. This addresses a different situation: An internal ERP system sends sensitive database extracts to Google Cloud but security rules prohibit unrestricted internet endpoints. The current scenario instead calls for the more directly applicable principle: Ordering requirements must be explicit, scoped, and supported by the message architecture. The reason is that ordering requirements must be explicit, scoped, and supported by the message architecture.
Question 428
The data engineering team must correct this issue: A popular dashboard repeatedly computes the same large daily summary with strict latency goals, while raw transactional records remain necessary for detail drill-down. Which controlled engineering action is MOST appropriate?
- Implement an appropriate type-2 dimension or equivalent temporal model with valid-time joins.
- Introduce appropriate reservation or workload controls while preserving governance.
- Evaluate an eligible materialized view or governed summary table for common aggregates.
- Build an incremental partition-aware load with validated late-change reconciliation.
Explanation
Correct Answer
C:Evaluate an eligible materialized view or governed summary table for common aggregates. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: Typical dashboards use the optimized summary and reconcile with detailed raw measures. Precomputed summary structures can improve repeated analytical response time where refresh limits and query patterns fit.
Incorrect Answers
A:Implement an appropriate type-2 dimension or equivalent temporal model with valid-time joins. This addresses a different situation: Customer account tiers change over time but year-old invoices must be reported using the tier effective at the invoice date. The current scenario instead calls for the more directly applicable engineering action: Evaluate an eligible materialized view or governed summary table for common aggregates. The reason is that precomputed summary structures can improve repeated analytical response time where refresh limits and query patterns fit.
B:Introduce appropriate reservation or workload controls while preserving governance. This addresses a different situation: Interactive analysts share BigQuery capacity with long overnight transformations, causing unpredictable daytime dashboard latencies. The current scenario instead calls for the more directly applicable engineering action: Evaluate an eligible materialized view or governed summary table for common aggregates. The reason is that precomputed summary structures can improve repeated analytical response time where refresh limits and query patterns fit.
D:Build an incremental partition-aware load with validated late-change reconciliation. This addresses a different situation: A daily fact table receives corrections, but each load recomputes every historical year and causes excessive query cost. The current scenario instead calls for the more directly applicable engineering action: Evaluate an eligible materialized view or governed summary table for common aggregates. The reason is that precomputed summary structures can improve repeated analytical response time where refresh limits and query patterns fit.
Question 429
The data engineering team must correct this issue: A research institute has hundreds of terabytes on isolated storage and cannot upload the first copy within its migration window. Which controlled engineering action is MOST appropriate?
- Evaluate an approved Transfer Appliance or equivalent controlled initial bulk-transfer approach.
- Run field-level and aggregate reconciliation with tolerances defined by financial owners.
- Configure supported Datastream change capture with consistent backfill and lag monitoring.
- Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies.
Explanation
Correct Answer
A:Evaluate an approved Transfer Appliance or equivalent controlled initial bulk-transfer approach. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A manifest confirms transferred object counts and checksums within the cutover window. Large data transfers must consider achievable network throughput, physical transfer options, and integrity.
Incorrect Answers
B:Run field-level and aggregate reconciliation with tolerances defined by financial owners. This addresses a different situation: A historical financial ledger migration matches table row counts but contains changed decimal precision in several high-value transactions. The current scenario instead calls for the more directly applicable engineering action: Evaluate an approved Transfer Appliance or equivalent controlled initial bulk-transfer approach. The reason is that large data transfers must consider achievable network throughput, physical transfer options, and integrity.
C:Configure supported Datastream change capture with consistent backfill and lag monitoring. This addresses a different situation: A retail database migration captures historical tables but fails to process updates made after the initial snapshot. The current scenario instead calls for the more directly applicable engineering action: Evaluate an approved Transfer Appliance or equivalent controlled initial bulk-transfer approach. The reason is that large data transfers must consider achievable network throughput, physical transfer options, and integrity.
D:Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies. This addresses a different situation: A batch Hadoop estate has custom Spark jobs and HDFS storage tightly coupled to aging servers. The current scenario instead calls for the more directly applicable engineering action: Evaluate an approved Transfer Appliance or equivalent controlled initial bulk-transfer approach. The reason is that large data transfers must consider achievable network throughput, physical transfer options, and integrity.
Question 430
A Google Cloud architecture review finds: An upstream vendor accidentally publishes a corrupted schema version and downstream totals become wrong before anyone notices. Which principle BEST explains the underlying data-engineering risk?
- Analytical recovery requires independently retained copies and known restore procedures that meet policy.
- Failover designs must preserve required write consistency and application connection semantics.
- Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
- High availability plans must address actual zonal failure domains and tested recovery behavior.
Explanation
Correct Answer
C:Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect affected partitions, ingestion manifests, validation history, and recovery sources. A focused corrective action is: Quarantine bad partitions and replay validated source data through controlled transformations.
Incorrect Answers
A:Analytical recovery requires independently retained copies and known restore procedures that meet policy. This addresses a different situation: A finance warehouse needs recoverable reporting after regional disruption but keeps its only critical dataset in one region. The current scenario instead calls for the more directly applicable principle: Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data. The reason is that reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
B:Failover designs must preserve required write consistency and application connection semantics. This addresses a different situation: An application routes financial writes to a stale read replica after primary failure, returning success before records are durably committed. The current scenario instead calls for the more directly applicable principle: Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data. The reason is that reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
D:High availability plans must address actual zonal failure domains and tested recovery behavior. This addresses a different situation: A production relational data source resides on a single-zone Cloud SQL instance and a zone outage stops all ingestion. The current scenario instead calls for the more directly applicable principle: Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data. The reason is that reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.