Google Professional Data Engineer Practice Test 54
Question 530
The data engineering team must correct this issue: Finance and logistics teams publish data independently, but a central team imposes one schema that ignores both domains' definitions. Which controlled engineering action is MOST appropriate?
- Create an approved Dataplex Catalog classification approach and map existing assets into it.
- Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails.
- Establish federated roles and a platform operating model with common policies and domain exceptions.
- Publish a versioned data contract with quality monitoring and consumer notification.
Explanation
Correct Answer
B:Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: Consumers find accountable owners and interoperable published data without centralizing every transformation. Federated data platform governance balances domain ownership with shared discovery and interoperability policies.
Incorrect Answers
A:Create an approved Dataplex Catalog classification approach and map existing assets into it. This addresses a different situation: A company acquires another business and wants consistent discovery and access classification across existing BigQuery and Cloud Storage assets. The current scenario instead calls for the more directly applicable engineering action: Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. The reason is that federated data platform governance balances domain ownership with shared discovery and interoperability policies.
C:Establish federated roles and a platform operating model with common policies and domain exceptions. This addresses a different situation: A global enterprise distributes data ownership to regional teams but needs one standard for naming, retention, and access requests. The current scenario instead calls for the more directly applicable engineering action: Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. The reason is that federated data platform governance balances domain ownership with shared discovery and interoperability policies.
D:Publish a versioned data contract with quality monitoring and consumer notification. This addresses a different situation: An internal data product is advertised as reliable, but consumers receive schema changes and delayed data without notice. The current scenario instead calls for the more directly applicable engineering action: Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. The reason is that federated data platform governance balances domain ownership with shared discovery and interoperability policies.
Question 531
A Google Cloud data engineer is addressing: A large BigQuery query fails with resources-exceeded errors and the operator sees only a generic dashboard red indicator. Which TWO complementary actions should the team take? Select TWO answers.
- Propagate stable pipeline-run identifiers through logs, jobs, and metrics.
- Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck.
- Tune publishing rates or request justified quota changes while preserving delivery semantics.
- Alert on sustained lack of event-time progress and remediate the blocking stage.
- Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message.
Explanation
Correct Answers
B:Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck. This is the applicable controlled engineering response. Its complementary step is: Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message. Together they address: Troubleshooting requires job-stage metrics, execution details, and precise failure context.
E:Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message. This is the applicable diagnostic investigation. Its complementary step is: Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck. Together they address: Troubleshooting requires job-stage metrics, execution details, and precise failure context.
Incorrect Answers
A:Propagate stable pipeline-run identifiers through logs, jobs, and metrics. This could be useful for another system: A daily pipeline fails across multiple microservices, but logs cannot connect the initial import to the final BigQuery job. For this situation, the necessary paired decisions are to examine (Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message.) and to implement (Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck.).
C:Tune publishing rates or request justified quota changes while preserving delivery semantics. This could be useful for another system: A burst exceeds Pub/Sub publisher limits and clients receive quota errors, but operations mistake the issue for subscriber crashes. For this situation, the necessary paired decisions are to examine (Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message.) and to implement (Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck.).
D:Alert on sustained lack of event-time progress and remediate the blocking stage. This could be useful for another system: A stream's reported job state stays Running while the actual consumer watermark stops moving for twenty minutes. For this situation, the necessary paired decisions are to examine (Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message.) and to implement (Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck.).
Question 532
A Google Cloud data engineer is addressing: An ecommerce service repeatedly looks up the same short-lived inventory recommendations and overwhelms its primary datastore during traffic peaks. Which TWO complementary actions should the team take? Select TWO answers.
- Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load.
- Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks.
- Evaluate a Bigtable schema with well-distributed row keys and tested scans.
- Configure supported PITR and conduct a rehearsal into an isolated recovery instance.
- Review legal retention periods, bucket settings, object holds, and administrator rights.
Explanation
Correct Answers
A:Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load. This is the applicable diagnostic investigation. Its complementary step is: Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks. Together they address: A managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
B:Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks. This is the applicable controlled engineering response. Its complementary step is: Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load. Together they address: A managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
Incorrect Answers
C:Evaluate a Bigtable schema with well-distributed row keys and tested scans. This could be useful for another system: A logistics app needs millisecond lookups for enormous numbers of sparse sensor rows keyed by device and time, with no requirement for SQL joins. For this situation, the necessary paired decisions are to examine (Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load.) and to implement (Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks.).
D:Configure supported PITR and conduct a rehearsal into an isolated recovery instance. This could be useful for another system: A PostgreSQL operational service needs to restore state from immediately before a faulty data migration, not merely from the last weekly export. For this situation, the necessary paired decisions are to examine (Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load.) and to implement (Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks.).
E:Review legal retention periods, bucket settings, object holds, and administrator rights. This could be useful for another system: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. For this situation, the necessary paired decisions are to examine (Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load.) and to implement (Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks.).
Question 533
The data engineering team must correct this issue: A marketing dashboard in Looker Studio displays performance summaries but the configured data source grants unrestricted access to restricted BigQuery customer fields. Which controlled engineering action is MOST appropriate?
- Design an eligible materialized aggregation and define an acceptable freshness contract.
- Use an approved restricted view or authorized dataset with scoped BI credentials.
- Use validated query parameters with reviewed field allowlists and read-only credentials.
- Evaluate BI Engine capacity and query optimization with representative dashboard workloads.
Explanation
Correct Answer
B:Use an approved restricted view or authorized dataset with scoped BI credentials. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A report viewer sees allowed campaign totals but cannot extract protected customer records. BI access must be governed at the data source and warehouse layer, not inferred from dashboard appearance.
Incorrect Answers
A:Design an eligible materialized aggregation and define an acceptable freshness contract. This addresses a different situation: A reporting team creates a materialized view but expects it to instantaneously reflect every base-table update under all query patterns. The current scenario instead calls for the more directly applicable engineering action: Use an approved restricted view or authorized dataset with scoped BI credentials. The reason is that bI access must be governed at the data source and warehouse layer, not inferred from dashboard appearance.
C:Use validated query parameters with reviewed field allowlists and read-only credentials. This addresses a different situation: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. The current scenario instead calls for the more directly applicable engineering action: Use an approved restricted view or authorized dataset with scoped BI credentials. The reason is that bI access must be governed at the data source and warehouse layer, not inferred from dashboard appearance.
D:Evaluate BI Engine capacity and query optimization with representative dashboard workloads. This addresses a different situation: A high-traffic operational dashboard executes recurring BigQuery aggregations and users complain about slow interactive response. The current scenario instead calls for the more directly applicable engineering action: Use an approved restricted view or authorized dataset with scoped BI credentials. The reason is that bI access must be governed at the data source and warehouse layer, not inferred from dashboard appearance.
Question 534
A design review evaluates this situation: A historical financial ledger migration matches table row counts but contains changed decimal precision in several high-value transactions. Which shortcut should the team MOST specifically avoid?
- Perform a one-time copy weeks before cutover and assume later source updates are irrelevant.
- Mark migration complete as soon as the initial table-copy job succeeds.
- Approve migration using only total row counts when financial values might change.
- Delete original files immediately after initiating asynchronous copies with no verification.
Explanation
Correct Answer
C:Approve migration using only total row counts when financial values might change. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Run field-level and aggregate reconciliation with tolerances defined by financial owners. Why: Migration validation needs business-value reconciliation beyond record counts.
Incorrect Answers
A:Perform a one-time copy weeks before cutover and assume later source updates are irrelevant. This addresses a different situation: An enterprise migrates a high-write transactional database to Google Cloud and cannot afford a long source freeze during cutover. The current scenario instead calls for the more directly applicable unsafe shortcut: Approve migration using only total row counts when financial values might change. The reason is that migration validation needs business-value reconciliation beyond record counts.
B:Mark migration complete as soon as the initial table-copy job succeeds. This addresses a different situation: A retail database migration captures historical tables but fails to process updates made after the initial snapshot. The current scenario instead calls for the more directly applicable unsafe shortcut: Approve migration using only total row counts when financial values might change. The reason is that migration validation needs business-value reconciliation beyond record counts.
D:Delete original files immediately after initiating asynchronous copies with no verification. This addresses a different situation: A partner shares daily updates while an organization copies older archives into a new Cloud Storage lake. The current scenario instead calls for the more directly applicable unsafe shortcut: Approve migration using only total row counts when financial values might change. The reason is that migration validation needs business-value reconciliation beyond record counts.
Question 535
Before modifying the data platform, the team observes: Device readings arrive every second but the related factory equipment registration data changes hourly, producing joins with missing references. Which evidence should the engineer examine FIRST?
- Inspect Spark UI shuffle metrics, skew, executor memory, and partition configuration.
- Review cluster utilization, job run time, startup overhead, and storage dependencies.
- Compare connector support, transformations, secret storage, and execution SLAs.
- Inspect data freshness, join keys, reference availability, and unjoined event metrics.
Explanation
Correct Answer
D:Inspect data freshness, join keys, reference availability, and unjoined event metrics. This evidence directly tests the uncertain part of the described system. Streaming enrichment needs bounded waits or defined fallback handling for delayed side inputs. A controlled response is: Introduce a valid temporal side input or keyed lookup with explicit late-reference reconciliation.
Incorrect Answers
A:Inspect Spark UI shuffle metrics, skew, executor memory, and partition configuration. This addresses a different situation: A Dataproc Spark batch shuffles terabytes into a handful of very large partitions and regularly runs out of memory. The current scenario instead calls for the more directly applicable investigation: Inspect data freshness, join keys, reference availability, and unjoined event metrics. The reason is that streaming enrichment needs bounded waits or defined fallback handling for delayed side inputs.
B:Review cluster utilization, job run time, startup overhead, and storage dependencies. This addresses a different situation: A once-weekly Spark transformation uses a permanently running Dataproc cluster that sits idle most of the week. The current scenario instead calls for the more directly applicable investigation: Inspect data freshness, join keys, reference availability, and unjoined event metrics. The reason is that streaming enrichment needs bounded waits or defined fallback handling for delayed side inputs.
C:Compare connector support, transformations, secret storage, and execution SLAs. This addresses a different situation: A team has several supported relational sources and needs standard cleansing workflows but maintains dozens of brittle custom extraction scripts. The current scenario instead calls for the more directly applicable investigation: Inspect data freshness, join keys, reference availability, and unjoined event metrics. The reason is that streaming enrichment needs bounded waits or defined fallback handling for delayed side inputs.
Question 536
After applying the change, the team re-examines this condition: Data teams use Cloud Storage for open formats and BigQuery for SQL, but each engine applies incompatible permissions to the same sensitive records. Which result BEST verifies the improvement?
- A search returns both businesses' governed assets with consistent sensitivity attributes.
- A cross-region access request follows an auditable owner approval without conflicting policies.
- A breaking sample change triggers controlled migration communication before being released.
- A restricted identity is denied the same sensitive records through both SQL and direct object paths.
Explanation
Correct Answer
D:A restricted identity is denied the same sensitive records through both SQL and direct object paths. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Implement a governed lakehouse catalog and role model that avoids bypass through raw object access. Multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
Incorrect Answers
A:A search returns both businesses' governed assets with consistent sensitivity attributes. This addresses a different situation: A company acquires another business and wants consistent discovery and access classification across existing BigQuery and Cloud Storage assets. The current scenario instead calls for the more directly applicable verification result: A restricted identity is denied the same sensitive records through both SQL and direct object paths. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
B:A cross-region access request follows an auditable owner approval without conflicting policies. This addresses a different situation: A global enterprise distributes data ownership to regional teams but needs one standard for naming, retention, and access requests. The current scenario instead calls for the more directly applicable verification result: A restricted identity is denied the same sensitive records through both SQL and direct object paths. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
C:A breaking sample change triggers controlled migration communication before being released. This addresses a different situation: An internal data product is advertised as reliable, but consumers receive schema changes and delayed data without notice. The current scenario instead calls for the more directly applicable verification result: A restricted identity is denied the same sensitive records through both SQL and direct object paths. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
Question 537
A Google Cloud data engineer is addressing: An engineer claims an exactly-once Dataflow pipeline makes arbitrary external API side effects impossible to duplicate. Which TWO complementary actions should the team take? Select TWO answers.
- Apply CDC changes using reliable source sequence/version ordering with replay safeguards.
- Build idempotent or transactional external writes with stable business event keys.
- Add structured error outputs and fail or quarantine according to the data contract.
- Examine sink contract, retry mechanics, transactional support, and event identifiers.
- Tune Dataflow worker limits and pipeline stages using measured bottlenecks.
Explanation
Correct Answers
B:Build idempotent or transactional external writes with stable business event keys. This is the applicable controlled engineering response. Its complementary step is: Examine sink contract, retry mechanics, transactional support, and event identifiers. Together they address: Pipeline execution guarantees do not automatically make non-idempotent external side effects exactly once.
D:Examine sink contract, retry mechanics, transactional support, and event identifiers. This is the applicable diagnostic investigation. Its complementary step is: Build idempotent or transactional external writes with stable business event keys. Together they address: Pipeline execution guarantees do not automatically make non-idempotent external side effects exactly once.
Incorrect Answers
A:Apply CDC changes using reliable source sequence/version ordering with replay safeguards. This could be useful for another system: Datastream CDC events sometimes reach the destination out of order after reconnection and older rows overwrite current values. For this situation, the necessary paired decisions are to examine (Examine sink contract, retry mechanics, transactional support, and event identifiers.) and to implement (Build idempotent or transactional external writes with stable business event keys.).
C:Add structured error outputs and fail or quarantine according to the data contract. This could be useful for another system: A Dataflow JavaScript or Python user-defined transform catches every exception and returns an empty record, hiding thousands of failed rows. For this situation, the necessary paired decisions are to examine (Examine sink contract, retry mechanics, transactional support, and event identifiers.) and to implement (Build idempotent or transactional external writes with stable business event keys.).
E:Tune Dataflow worker limits and pipeline stages using measured bottlenecks. This could be useful for another system: During a marketing campaign, Pub/Sub backlog grows and Dataflow workers remain fixed far below incoming throughput. For this situation, the necessary paired decisions are to examine (Examine sink contract, retry mechanics, transactional support, and event identifiers.) and to implement (Build idempotent or transactional external writes with stable business event keys.).
Question 538
Before modifying the data platform, the team observes: A logistics app needs millisecond lookups for enormous numbers of sparse sensor rows keyed by device and time, with no requirement for SQL joins. Which evidence should the engineer examine FIRST?
- Inspect access paths, row-key distribution, write bursts, and query predicate patterns.
- Review transaction isolation needs, region placement, query patterns, and write contention.
- Inspect Cloud SQL backup policy, transaction logs, recovery window, and RPO/RTO.
- Review legal retention periods, bucket settings, object holds, and administrator rights.
Explanation
Correct Answer
A:Inspect access paths, row-key distribution, write bursts, and query predicate patterns. This evidence directly tests the uncertain part of the described system. Bigtable is appropriate for certain high-throughput low-latency key-oriented workloads when row-key design is sound. A controlled response is: Evaluate a Bigtable schema with well-distributed row keys and tested scans.
Incorrect Answers
B:Review transaction isolation needs, region placement, query patterns, and write contention. This addresses a different situation: A global order platform needs strongly consistent relational transactions across geographic users and plans to scale beyond a single traditional database instance. The current scenario instead calls for the more directly applicable investigation: Inspect access paths, row-key distribution, write bursts, and query predicate patterns. The reason is that bigtable is appropriate for certain high-throughput low-latency key-oriented workloads when row-key design is sound.
C:Inspect Cloud SQL backup policy, transaction logs, recovery window, and RPO/RTO. This addresses a different situation: A PostgreSQL operational service needs to restore state from immediately before a faulty data migration, not merely from the last weekly export. The current scenario instead calls for the more directly applicable investigation: Inspect access paths, row-key distribution, write bursts, and query predicate patterns. The reason is that bigtable is appropriate for certain high-throughput low-latency key-oriented workloads when row-key design is sound.
D:Review legal retention periods, bucket settings, object holds, and administrator rights. This addresses a different situation: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. The current scenario instead calls for the more directly applicable investigation: Inspect access paths, row-key distribution, write bursts, and query predicate patterns. The reason is that bigtable is appropriate for certain high-throughput low-latency key-oriented workloads when row-key design is sound.
Question 539
A Google Cloud data engineer is addressing: A media archive changes every object to the coldest storage class even though analysts read recent objects daily. Which TWO complementary actions should the team take? Select TWO answers.
- Review object access frequency, retention, retrieval cost, and lifecycle rules.
- Inspect Dataproc CPU usage, YARN metrics, cluster autoscaling settings, and job boundaries.
- Assign storage classes and transitions based on measured access patterns and compliance.
- Right-size workers and improve the serial input bottleneck before increasing capacity.
- Choose an appropriate BigQuery Editions reservation arrangement and workload assignments.
Explanation
Correct Answers
A:Review object access frequency, retention, retrieval cost, and lifecycle rules. This is the applicable diagnostic investigation. Its complementary step is: Assign storage classes and transitions based on measured access patterns and compliance. Together they address: Storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
C:Assign storage classes and transitions based on measured access patterns and compliance. This is the applicable controlled engineering response. Its complementary step is: Review object access frequency, retention, retrieval cost, and lifecycle rules. Together they address: Storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
Incorrect Answers
B:Inspect Dataproc CPU usage, YARN metrics, cluster autoscaling settings, and job boundaries. This could be useful for another system: A large Spark cluster remains at peak worker count during long idle stages because autoscaling is disabled. For this situation, the necessary paired decisions are to examine (Review object access frequency, retention, retrieval cost, and lifecycle rules.) and to implement (Assign storage classes and transitions based on measured access patterns and compliance.).
D:Right-size workers and improve the serial input bottleneck before increasing capacity. This could be useful for another system: A Dataflow batch pipeline processes a few large files using hundreds of workers while bottlenecked on one serialized source stage. For this situation, the necessary paired decisions are to examine (Review object access frequency, retention, retrieval cost, and lifecycle rules.) and to implement (Assign storage classes and transitions based on measured access patterns and compliance.).
E:Choose an appropriate BigQuery Editions reservation arrangement and workload assignments. This could be useful for another system: Critical dashboards compete with scheduled ETL jobs for BigQuery slots and miss interactive latency targets. For this situation, the necessary paired decisions are to examine (Review object access frequency, retention, retrieval cost, and lifecycle rules.) and to implement (Assign storage classes and transitions based on measured access patterns and compliance.).
Question 540
The data engineering team must correct this issue: Datastream CDC events sometimes reach the destination out of order after reconnection and older rows overwrite current values. Which controlled engineering action is MOST appropriate?
- Redesign the aggregation key or introduce valid fan-out patterns where supported.
- Define product IDs as string fields and validate source formats before BigQuery loading.
- Apply CDC changes using reliable source sequence/version ordering with replay safeguards.
- Configure Apache Beam windows and late-data handling appropriate to the report contract.
Explanation
Correct Answer
C:Apply CDC changes using reliable source sequence/version ordering with replay safeguards. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: An injected delayed older update cannot replace the latest committed source state. CDC processing must respect source transaction order or version markers.
Incorrect Answers
A:Redesign the aggregation key or introduce valid fan-out patterns where supported. This addresses a different situation: A Dataflow group-by-key stage slows because almost all events share one constant grouping value. The current scenario instead calls for the more directly applicable engineering action: Apply CDC changes using reliable source sequence/version ordering with replay safeguards. The reason is that cDC processing must respect source transaction order or version markers.
B:Define product IDs as string fields and validate source formats before BigQuery loading. This addresses a different situation: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. The current scenario instead calls for the more directly applicable engineering action: Apply CDC changes using reliable source sequence/version ordering with replay safeguards. The reason is that cDC processing must respect source transaction order or version markers.
D:Configure Apache Beam windows and late-data handling appropriate to the report contract. This addresses a different situation: A fraud model groups purchases into ten-minute windows, but late device clocks place events into the wrong billing period. The current scenario instead calls for the more directly applicable engineering action: Apply CDC changes using reliable source sequence/version ordering with replay safeguards. The reason is that cDC processing must respect source transaction order or version markers.