Google Professional Data Engineer Practice Test 53
Question 520
Before modifying the data platform, the team observes: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. Which evidence should the engineer examine FIRST?
- Review UDF exceptions, input samples, metrics, and dead-letter records.
- Review source data dictionary, sample values, load schema options, and rejected row records.
- Review cluster utilization, job run time, startup overhead, and storage dependencies.
- Inspect object creation events, generation numbers, filename rules, and duplicate triggers.
Explanation
Correct Answer
B:Review source data dictionary, sample values, load schema options, and rejected row records. This evidence directly tests the uncertain part of the described system. Ingestion should use explicit schemas where data semantics cannot be inferred reliably. A controlled response is: Define product IDs as string fields and validate source formats before BigQuery loading.
Incorrect Answers
A:Review UDF exceptions, input samples, metrics, and dead-letter records. This addresses a different situation: A Dataflow JavaScript or Python user-defined transform catches every exception and returns an empty record, hiding thousands of failed rows. The current scenario instead calls for the more directly applicable investigation: Review source data dictionary, sample values, load schema options, and rejected row records. The reason is that ingestion should use explicit schemas where data semantics cannot be inferred reliably.
C:Review cluster utilization, job run time, startup overhead, and storage dependencies. This addresses a different situation: A once-weekly Spark transformation uses a permanently running Dataproc cluster that sits idle most of the week. The current scenario instead calls for the more directly applicable investigation: Review source data dictionary, sample values, load schema options, and rejected row records. The reason is that ingestion should use explicit schemas where data semantics cannot be inferred reliably.
D:Inspect object creation events, generation numbers, filename rules, and duplicate triggers. This addresses a different situation: A pipeline should start only after a new approved object lands in a bucket, but currently polls every minute and processes partially copied files. The current scenario instead calls for the more directly applicable investigation: Review source data dictionary, sample values, load schema options, and rejected row records. The reason is that ingestion should use explicit schemas where data semantics cannot be inferred reliably.
Question 521
The data engineering team must correct this issue: A media archive changes every object to the coldest storage class even though analysts read recent objects daily. Which controlled engineering action is MOST appropriate?
- Assign storage classes and transitions based on measured access patterns and compliance.
- Apply a supported autoscaling policy or job-based execution with performance safeguards.
- Rewrite queries to project required fields and prune partitions with cost monitoring.
- Right-size workers and improve the serial input bottleneck before increasing capacity.
Explanation
Correct Answer
A:Assign storage classes and transitions based on measured access patterns and compliance. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A typical month of reads and storage has a lower total cost without violating access needs. Storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
Incorrect Answers
B:Apply a supported autoscaling policy or job-based execution with performance safeguards. This addresses a different situation: A large Spark cluster remains at peak worker count during long idle stages because autoscaling is disabled. The current scenario instead calls for the more directly applicable engineering action: Assign storage classes and transitions based on measured access patterns and compliance. The reason is that storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
C:Rewrite queries to project required fields and prune partitions with cost monitoring. This addresses a different situation: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. The current scenario instead calls for the more directly applicable engineering action: Assign storage classes and transitions based on measured access patterns and compliance. The reason is that storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
D:Right-size workers and improve the serial input bottleneck before increasing capacity. This addresses a different situation: A Dataflow batch pipeline processes a few large files using hundreds of workers while bottlenecked on one serialized source stage. The current scenario instead calls for the more directly applicable engineering action: Assign storage classes and transitions based on measured access patterns and compliance. The reason is that storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
Question 522
A Google Cloud data engineer is addressing: Three applications produce events into a common stream, and one deploys a breaking field rename without notifying downstream consumers. Which TWO complementary actions should the team take? Select TWO answers.
- Enforce registry or versioned schema compatibility checks before deploying producer changes.
- Design elastic ingestion and partitioned analytical storage with stable governed interfaces.
- Review schema versions, producer changes, consumer dependencies, and failed-message records.
- Inventory datasets, owners, classifications, descriptions, and upstream-downstream dependencies.
- Review source formats, SQL dialect assumptions, pipeline definitions, and operational dependencies.
Explanation
Correct Answers
A:Enforce registry or versioned schema compatibility checks before deploying producer changes. This is the applicable controlled engineering response. Its complementary step is: Review schema versions, producer changes, consumer dependencies, and failed-message records. Together they address: Shared data contracts need compatible evolution rules and consumer validation.
C:Review schema versions, producer changes, consumer dependencies, and failed-message records. This is the applicable diagnostic investigation. Its complementary step is: Enforce registry or versioned schema compatibility checks before deploying producer changes. Together they address: Shared data contracts need compatible evolution rules and consumer validation.
Incorrect Answers
B:Design elastic ingestion and partitioned analytical storage with stable governed interfaces. This could be useful for another system: A pilot warehouse handles thousands of daily events but must support hundreds of millions without rewriting every consuming dashboard. For this situation, the necessary paired decisions are to examine (Review schema versions, producer changes, consumer dependencies, and failed-message records.) and to implement (Enforce registry or versioned schema compatibility checks before deploying producer changes.).
D:Inventory datasets, owners, classifications, descriptions, and upstream-downstream dependencies. This could be useful for another system: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. For this situation, the necessary paired decisions are to examine (Review schema versions, producer changes, consumer dependencies, and failed-message records.) and to implement (Enforce registry or versioned schema compatibility checks before deploying producer changes.).
E:Review source formats, SQL dialect assumptions, pipeline definitions, and operational dependencies. This could be useful for another system: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. For this situation, the necessary paired decisions are to examine (Review schema versions, producer changes, consumer dependencies, and failed-message records.) and to implement (Enforce registry or versioned schema compatibility checks before deploying producer changes.).
Question 523
The data engineering team must correct this issue: Developers test destructive transformations against the same production dataset used for regulatory reporting. Which controlled engineering action is MOST appropriate?
- Create isolated nonproduction projects and datasets with masked test fixtures and deployment gates.
- Apply approved column policy tags and corresponding fine-grained access controls.
- Apply reviewed organization policies at the appropriate hierarchy scope and document approved exemptions.
- Grant the narrow dataset and job-execution permissions required, avoiding project-wide administration.
Explanation
Correct Answer
A:Create isolated nonproduction projects and datasets with masked test fixtures and deployment gates. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: An attempted development-table deletion cannot affect the production reporting dataset. Separate development and production boundaries limit the impact of exploratory and destructive data operations.
Incorrect Answers
B:Apply approved column policy tags and corresponding fine-grained access controls. This addresses a different situation: Analysts may inspect product transactions but only a small fraud group may see a sensitive risk score in the same table. The current scenario instead calls for the more directly applicable engineering action: Create isolated nonproduction projects and datasets with masked test fixtures and deployment gates. The reason is that separate development and production boundaries limit the impact of exploratory and destructive data operations.
C:Apply reviewed organization policies at the appropriate hierarchy scope and document approved exemptions. This addresses a different situation: Several developer projects can create external IP resources and unrestricted service-account keys even though the organization prohibits them. The current scenario instead calls for the more directly applicable engineering action: Create isolated nonproduction projects and datasets with masked test fixtures and deployment gates. The reason is that separate development and production boundaries limit the impact of exploratory and destructive data operations.
D:Grant the narrow dataset and job-execution permissions required, avoiding project-wide administration. This addresses a different situation: An analytics contractor needs to query one approved sales dataset, but the administrator proposes granting project-wide BigQuery Admin privileges. The current scenario instead calls for the more directly applicable engineering action: Create isolated nonproduction projects and datasets with masked test fixtures and deployment gates. The reason is that separate development and production boundaries limit the impact of exploratory and destructive data operations.
Question 524
A Google Cloud architecture review finds: A PostgreSQL operational service needs to restore state from immediately before a faulty data migration, not merely from the last weekly export. Which principle BEST explains the underlying data-engineering risk?
- Partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates.
- AlloyDB may suit demanding PostgreSQL-compatible operational workloads when measured capabilities and costs fit.
- Point-in-time recovery depends on supported continuous backups/log retention and tested restoration.
- Retention and hold controls can protect governed objects against premature removal.
Explanation
Correct Answer
C:Point-in-time recovery depends on supported continuous backups/log retention and tested restoration. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect Cloud SQL backup policy, transaction logs, recovery window, and RPO/RTO. A focused corrective action is: Configure supported PITR and conduct a rehearsal into an isolated recovery instance.
Incorrect Answers
A:Partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates. This addresses a different situation: A warehouse stores years of events and most reports filter by event date and customer segment, but all queries scan the full table. The current scenario instead calls for the more directly applicable principle: Point-in-time recovery depends on supported continuous backups/log retention and tested restoration. The reason is that point-in-time recovery depends on supported continuous backups/log retention and tested restoration.
B:AlloyDB may suit demanding PostgreSQL-compatible operational workloads when measured capabilities and costs fit. This addresses a different situation: A PostgreSQL-compatible application has intensive operational transactions plus complex analytical queries and wants compatible managed performance options. The current scenario instead calls for the more directly applicable principle: Point-in-time recovery depends on supported continuous backups/log retention and tested restoration. The reason is that point-in-time recovery depends on supported continuous backups/log retention and tested restoration.
D:Retention and hold controls can protect governed objects against premature removal. This addresses a different situation: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. The current scenario instead calls for the more directly applicable principle: Point-in-time recovery depends on supported continuous backups/log retention and tested restoration. The reason is that point-in-time recovery depends on supported continuous backups/log retention and tested restoration.
Question 525
Before modifying the data platform, the team observes: An upstream vendor accidentally publishes a corrupted schema version and downstream totals become wrong before anyone notices. Which evidence should the engineer examine FIRST?
- Review availability configuration, application connection recovery, backups, and zone dependencies.
- Review primary and replica roles, consistency modes, transaction commit paths, and failover configuration.
- Inspect source retention, worker state, destination location, regional permissions, and documented steps.
- Inspect affected partitions, ingestion manifests, validation history, and recovery sources.
Explanation
Correct Answer
D:Inspect affected partitions, ingestion manifests, validation history, and recovery sources. This evidence directly tests the uncertain part of the described system. Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data. A controlled response is: Quarantine bad partitions and replay validated source data through controlled transformations.
Incorrect Answers
A:Review availability configuration, application connection recovery, backups, and zone dependencies. This addresses a different situation: A production relational data source resides on a single-zone Cloud SQL instance and a zone outage stops all ingestion. The current scenario instead calls for the more directly applicable investigation: Inspect affected partitions, ingestion manifests, validation history, and recovery sources. The reason is that reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
B:Review primary and replica roles, consistency modes, transaction commit paths, and failover configuration. This addresses a different situation: An application routes financial writes to a stale read replica after primary failure, returning success before records are durably committed. The current scenario instead calls for the more directly applicable investigation: Inspect affected partitions, ingestion manifests, validation history, and recovery sources. The reason is that reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
C:Inspect source retention, worker state, destination location, regional permissions, and documented steps. This addresses a different situation: A critical Pub/Sub-to-warehouse flow has a secondary-region deployment template but no retained state, failover routing, or test exercise. The current scenario instead calls for the more directly applicable investigation: Inspect affected partitions, ingestion manifests, validation history, and recovery sources. The reason is that reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
Question 526
A design review evaluates this situation: A stream's reported job state stays Running while the actual consumer watermark stops moving for twenty minutes. Which shortcut should the team MOST specifically avoid?
- Search unrelated log messages by approximate wall time as the only diagnostic linkage.
- Increase Cloud Storage bucket quota without examining BigQuery query execution failures.
- Assume a green process-status icon proves every event is current.
- Mark a workflow healthy solely because the SQL transform query itself completed.
Explanation
Correct Answer
C:Assume a green process-status icon proves every event is current. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Alert on sustained lack of event-time progress and remediate the blocking stage. Why: Pipeline health must include progress, latency, and backlog indicators beyond process liveness.
Incorrect Answers
A:Search unrelated log messages by approximate wall time as the only diagnostic linkage. This addresses a different situation: A daily pipeline fails across multiple microservices, but logs cannot connect the initial import to the final BigQuery job. The current scenario instead calls for the more directly applicable unsafe shortcut: Assume a green process-status icon proves every event is current. The reason is that pipeline health must include progress, latency, and backlog indicators beyond process liveness.
B:Increase Cloud Storage bucket quota without examining BigQuery query execution failures. This addresses a different situation: A large BigQuery query fails with resources-exceeded errors and the operator sees only a generic dashboard red indicator. The current scenario instead calls for the more directly applicable unsafe shortcut: Assume a green process-status icon proves every event is current. The reason is that pipeline health must include progress, latency, and backlog indicators beyond process liveness.
D:Mark a workflow healthy solely because the SQL transform query itself completed. This addresses a different situation: An automated Dataform transform completes, but one critical assertion reports failed rows and no team is notified. The current scenario instead calls for the more directly applicable unsafe shortcut: Assume a green process-status icon proves every event is current. The reason is that pipeline health must include progress, latency, and backlog indicators beyond process liveness.
Question 527
After applying the change, the team re-examines this condition: A data lake ingestion job repeatedly misses one daily source partition yet storage dashboards show only total object count. Which result BEST verifies the improvement?
- An authorized researcher finds the correct lake dataset and understands its ownership and sensitivity.
- An incompatible JSON change is flagged and does not silently enter certified lake tables.
- Unused scratch output expires while legal records and required lineage artifacts remain intact.
- A deliberately absent daily partition triggers a reliable alert before downstream reporting.
Explanation
Correct Answer
D:A deliberately absent daily partition triggers a reliable alert before downstream reporting. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Implement per-source completeness checks with actionable missing-partition alerts. Lake operational monitoring needs partition completeness and business-level freshness signals.
Incorrect Answers
A:An authorized researcher finds the correct lake dataset and understands its ownership and sensitivity. This addresses a different situation: Researchers place thousands of raw objects in a data lake and cannot identify schemas, ownership, or classification. The current scenario instead calls for the more directly applicable verification result: A deliberately absent daily partition triggers a reliable alert before downstream reporting. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.
B:An incompatible JSON change is flagged and does not silently enter certified lake tables. This addresses a different situation: Multiple departments publish raw JSON to a shared lake with inconsistent field definitions that break downstream reusable tables. The current scenario instead calls for the more directly applicable verification result: A deliberately absent daily partition triggers a reliable alert before downstream reporting. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.
C:Unused scratch output expires while legal records and required lineage artifacts remain intact. This addresses a different situation: A lake accumulates experimental intermediate outputs that cost more than final retained datasets and lacks automated expiration. The current scenario instead calls for the more directly applicable verification result: A deliberately absent daily partition triggers a reliable alert before downstream reporting. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.
Question 528
Before modifying the data platform, the team observes: A production relational data source resides on a single-zone Cloud SQL instance and a zone outage stops all ingestion. Which evidence should the engineer examine FIRST?
- Inspect dataset locations, backup/copy capabilities, recovery targets, and permitted residency.
- Review availability configuration, application connection recovery, backups, and zone dependencies.
- Inspect affected partitions, ingestion manifests, validation history, and recovery sources.
- Review primary and replica roles, consistency modes, transaction commit paths, and failover configuration.
Explanation
Correct Answer
B:Review availability configuration, application connection recovery, backups, and zone dependencies. This evidence directly tests the uncertain part of the described system. High availability plans must address actual zonal failure domains and tested recovery behavior. A controlled response is: Configure supported regional high availability and test application reconnection.
Incorrect Answers
A:Inspect dataset locations, backup/copy capabilities, recovery targets, and permitted residency. This addresses a different situation: A finance warehouse needs recoverable reporting after regional disruption but keeps its only critical dataset in one region. The current scenario instead calls for the more directly applicable investigation: Review availability configuration, application connection recovery, backups, and zone dependencies. The reason is that high availability plans must address actual zonal failure domains and tested recovery behavior.
C:Inspect affected partitions, ingestion manifests, validation history, and recovery sources. This addresses a different situation: An upstream vendor accidentally publishes a corrupted schema version and downstream totals become wrong before anyone notices. The current scenario instead calls for the more directly applicable investigation: Review availability configuration, application connection recovery, backups, and zone dependencies. The reason is that high availability plans must address actual zonal failure domains and tested recovery behavior.
D:Review primary and replica roles, consistency modes, transaction commit paths, and failover configuration. This addresses a different situation: An application routes financial writes to a stale read replica after primary failure, returning success before records are durably committed. The current scenario instead calls for the more directly applicable investigation: Review availability configuration, application connection recovery, backups, and zone dependencies. The reason is that high availability plans must address actual zonal failure domains and tested recovery behavior.
Question 529
Before modifying the data platform, the team observes: Analysts need aggregate insurance-risk reporting while only authorized reviewers may see exact claimant identifiers. Which evidence should the engineer examine FIRST?
- Inspect dataset grants, policy tags, masking roles, and existing report queries.
- Review metric grains, join keys, time zones, and calculated-field definitions.
- Inspect query plan, partition filter expressions, bytes processed, and table partitioning.
- Inspect SQL construction, parameter values, connector authorization, and query errors.
Explanation
Correct Answer
A:Inspect dataset grants, policy tags, masking roles, and existing report queries. This evidence directly tests the uncertain part of the described system. Dynamic masking and column access policies can limit sensitive detail without removing analytical utility. A controlled response is: Apply supported BigQuery data masking policies and verify behavior for each role.
Incorrect Answers
B:Review metric grains, join keys, time zones, and calculated-field definitions. This addresses a different situation: A sales dashboard adds hourly clicks to daily orders with a join on date only, producing inflated conversion rates. The current scenario instead calls for the more directly applicable investigation: Inspect dataset grants, policy tags, masking roles, and existing report queries. The reason is that dynamic masking and column access policies can limit sensitive detail without removing analytical utility.
C:Inspect query plan, partition filter expressions, bytes processed, and table partitioning. This addresses a different situation: An analyst filters a partitioned BigQuery table by wrapping the partition column in a complex function and sees a costly full scan. The current scenario instead calls for the more directly applicable investigation: Inspect dataset grants, policy tags, masking roles, and existing report queries. The reason is that dynamic masking and column access policies can limit sensitive detail without removing analytical utility.
D:Inspect SQL construction, parameter values, connector authorization, and query errors. This addresses a different situation: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. The current scenario instead calls for the more directly applicable investigation: Inspect dataset grants, policy tags, masking roles, and existing report queries. The reason is that dynamic masking and column access policies can limit sensitive detail without removing analytical utility.
Question 530
The data engineering team must correct this issue: Finance and logistics teams publish data independently, but a central team imposes one schema that ignores both domains' definitions. Which controlled engineering action is MOST appropriate?
- Create an approved Dataplex Catalog classification approach and map existing assets into it.
- Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails.
- Establish federated roles and a platform operating model with common policies and domain exceptions.
- Publish a versioned data contract with quality monitoring and consumer notification.
Explanation
Correct Answer
B:Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: Consumers find accountable owners and interoperable published data without centralizing every transformation. Federated data platform governance balances domain ownership with shared discovery and interoperability policies.
Incorrect Answers
A:Create an approved Dataplex Catalog classification approach and map existing assets into it. This addresses a different situation: A company acquires another business and wants consistent discovery and access classification across existing BigQuery and Cloud Storage assets. The current scenario instead calls for the more directly applicable engineering action: Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. The reason is that federated data platform governance balances domain ownership with shared discovery and interoperability policies.
C:Establish federated roles and a platform operating model with common policies and domain exceptions. This addresses a different situation: A global enterprise distributes data ownership to regional teams but needs one standard for naming, retention, and access requests. The current scenario instead calls for the more directly applicable engineering action: Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. The reason is that federated data platform governance balances domain ownership with shared discovery and interoperability policies.
D:Publish a versioned data contract with quality monitoring and consumer notification. This addresses a different situation: An internal data product is advertised as reliable, but consumers receive schema changes and delayed data without notice. The current scenario instead calls for the more directly applicable engineering action: Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. The reason is that federated data platform governance balances domain ownership with shared discovery and interoperability policies.