Google Professional Data Engineer Practice Test 63
Question 620
A Google Cloud architecture review finds: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. Which principle BEST explains the underlying data-engineering risk?
- Deployment portability requires parameterized environment-specific resources and validated locations.
- Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
- Shared data contracts need compatible evolution rules and consumer validation.
- Cataloging and lineage metadata support discoverability, stewardship, and trusted reuse.
Explanation
Correct Answer
B:Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Review source formats, SQL dialect assumptions, pipeline definitions, and operational dependencies. A focused corrective action is: Separate portable transformation logic from provider-specific orchestration and version the deployment configuration.
Incorrect Answers
A:Deployment portability requires parameterized environment-specific resources and validated locations. This addresses a different situation: A pipeline deployment hardcodes one project ID and dataset location into every query, blocking deployment into another approved region. The current scenario instead calls for the more directly applicable principle: Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
C:Shared data contracts need compatible evolution rules and consumer validation. This addresses a different situation: Three applications produce events into a common stream, and one deploys a breaking field rename without notifying downstream consumers. The current scenario instead calls for the more directly applicable principle: Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
D:Cataloging and lineage metadata support discoverability, stewardship, and trusted reuse. This addresses a different situation: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. The current scenario instead calls for the more directly applicable principle: Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
Question 621
Before modifying the data platform, the team observes: A media archive changes every object to the coldest storage class even though analysts read recent objects daily. Which evidence should the engineer examine FIRST?
- Inspect Cloud Scheduler timezone, cron expression, daylight rules, and report SLA.
- Inspect Dataproc CPU usage, YARN metrics, cluster autoscaling settings, and job boundaries.
- Inspect BigQuery job statistics, query projections, filters, and data partitions.
- Review object access frequency, retention, retrieval cost, and lifecycle rules.
Explanation
Correct Answer
D:Review object access frequency, retention, retrieval cost, and lifecycle rules. This evidence directly tests the uncertain part of the described system. Storage-class economics include retrieval fees and minimum duration, not only price per stored GB. A controlled response is: Assign storage classes and transitions based on measured access patterns and compliance.
Incorrect Answers
A:Inspect Cloud Scheduler timezone, cron expression, daylight rules, and report SLA. This addresses a different situation: A daily report must run at 08:00 business time, but the scheduler is configured in UTC and shifts unexpectedly after regional daylight changes. The current scenario instead calls for the more directly applicable investigation: Review object access frequency, retention, retrieval cost, and lifecycle rules. The reason is that storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
B:Inspect Dataproc CPU usage, YARN metrics, cluster autoscaling settings, and job boundaries. This addresses a different situation: A large Spark cluster remains at peak worker count during long idle stages because autoscaling is disabled. The current scenario instead calls for the more directly applicable investigation: Review object access frequency, retention, retrieval cost, and lifecycle rules. The reason is that storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
C:Inspect BigQuery job statistics, query projections, filters, and data partitions. This addresses a different situation: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. The current scenario instead calls for the more directly applicable investigation: Review object access frequency, retention, retrieval cost, and lifecycle rules. The reason is that storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
Question 622
A Google Cloud data engineer is addressing: A once-weekly Spark transformation uses a permanently running Dataproc cluster that sits idle most of the week. Which TWO complementary actions should the team take? Select TWO answers.
- Review cluster utilization, job run time, startup overhead, and storage dependencies.
- Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution.
- Inspect object creation events, generation numbers, filename rules, and duplicate triggers.
- Review source data dictionary, sample values, load schema options, and rejected row records.
- Review event timestamps, watermark progress, late-data distribution, and aggregation triggers.
Explanation
Correct Answers
A:Review cluster utilization, job run time, startup overhead, and storage dependencies. This is the applicable diagnostic investigation. Its complementary step is: Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution. Together they address: Job-scoped managed compute can reduce idle cost for intermittent batch workloads.
B:Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution. This is the applicable controlled engineering response. Its complementary step is: Review cluster utilization, job run time, startup overhead, and storage dependencies. Together they address: Job-scoped managed compute can reduce idle cost for intermittent batch workloads.
Incorrect Answers
C:Inspect object creation events, generation numbers, filename rules, and duplicate triggers. This could be useful for another system: A pipeline should start only after a new approved object lands in a bucket, but currently polls every minute and processes partially copied files. For this situation, the necessary paired decisions are to examine (Review cluster utilization, job run time, startup overhead, and storage dependencies.) and to implement (Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution.).
D:Review source data dictionary, sample values, load schema options, and rejected row records. This could be useful for another system: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. For this situation, the necessary paired decisions are to examine (Review cluster utilization, job run time, startup overhead, and storage dependencies.) and to implement (Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution.).
E:Review event timestamps, watermark progress, late-data distribution, and aggregation triggers. This could be useful for another system: A fraud model groups purchases into ten-minute windows, but late device clocks place events into the wrong billing period. For this situation, the necessary paired decisions are to examine (Review cluster utilization, job run time, startup overhead, and storage dependencies.) and to implement (Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution.).
Question 623
After applying the change, the team re-examines this condition: A Dataflow job in a processing project reads raw data from an ingestion project but uses a broad human administrator credential. Which result BEST verifies the improvement?
- The pipeline succeeds without personal credentials and cannot read an unrelated restricted source.
- A test identity queries the authorized dataset but cannot read a separate payroll dataset.
- A test project cannot create prohibited resources while approved deployment patterns still work.
- Audited processing and copies remain in permitted regions throughout the full pipeline.
Explanation
Correct Answer
A:The pipeline succeeds without personal credentials and cannot read an unrelated restricted source. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Use a dedicated worker service account with minimal permissions on approved source and destination resources. Dedicated workload identities with scoped cross-project permissions improve least privilege and lifecycle control.
Incorrect Answers
B:A test identity queries the authorized dataset but cannot read a separate payroll dataset. This addresses a different situation: An analytics contractor needs to query one approved sales dataset, but the administrator proposes granting project-wide BigQuery Admin privileges. The current scenario instead calls for the more directly applicable verification result: The pipeline succeeds without personal credentials and cannot read an unrelated restricted source. The reason is that dedicated workload identities with scoped cross-project permissions improve least privilege and lifecycle control.
C:A test project cannot create prohibited resources while approved deployment patterns still work. This addresses a different situation: Several developer projects can create external IP resources and unrestricted service-account keys even though the organization prohibits them. The current scenario instead calls for the more directly applicable verification result: The pipeline succeeds without personal credentials and cannot read an unrelated restricted source. The reason is that dedicated workload identities with scoped cross-project permissions improve least privilege and lifecycle control.
D:Audited processing and copies remain in permitted regions throughout the full pipeline. This addresses a different situation: A European customer contract restricts processing and storage to approved locations, while engineers intend to replicate datasets to another continent. The current scenario instead calls for the more directly applicable verification result: The pipeline succeeds without personal credentials and cannot read an unrelated restricted source. The reason is that dedicated workload identities with scoped cross-project permissions improve least privilege and lifecycle control.
Question 624
Before modifying the data platform, the team observes: A nightly sales feed occasionally omits required currency codes, but the current BigQuery load marks every run successful. Which evidence should the engineer examine FIRST?
- Review source schema, null rates, accepted values, and downstream financial calculations.
- Review Dataform dependency definitions, execution timestamps, assertions, and SQL references.
- Review RPO/RTO requirements, region dependencies, replication design, and backup restoration tests.
- Inspect job state, checkpoints, replay source retention, watermarks, and sink write behavior.
Explanation
Correct Answer
A:Review source schema, null rates, accepted values, and downstream financial calculations. This evidence directly tests the uncertain part of the described system. Data validation must verify business semantics, not just successful file ingestion. A controlled response is: Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates.
Incorrect Answers
B:Review Dataform dependency definitions, execution timestamps, assertions, and SQL references. This addresses a different situation: A Dataform pipeline materializes monthly revenue before its upstream exchange-rate table refresh completes. The current scenario instead calls for the more directly applicable investigation: Review source schema, null rates, accepted values, and downstream financial calculations. The reason is that data validation must verify business semantics, not just successful file ingestion.
C:Review RPO/RTO requirements, region dependencies, replication design, and backup restoration tests. This addresses a different situation: A regional processing failure stops daily regulatory datasets because all staging, computation, and recovery copies reside in one failure domain. The current scenario instead calls for the more directly applicable investigation: Review source schema, null rates, accepted values, and downstream financial calculations. The reason is that data validation must verify business semantics, not just successful file ingestion.
D:Inspect job state, checkpoints, replay source retention, watermarks, and sink write behavior. This addresses a different situation: A six-hour streaming Dataflow job is relaunched after worker failure and loses uncommitted state when operators create a new pipeline without recovery planning. The current scenario instead calls for the more directly applicable investigation: Review source schema, null rates, accepted values, and downstream financial calculations. The reason is that data validation must verify business semantics, not just successful file ingestion.
Question 625
The data engineering team must correct this issue: An events schema contains orders with many line items and analysts often query an order together with its items as one logical document. Which controlled engineering action is MOST appropriate?
- Evaluate a nested repeated line-item representation and write correct UNNEST queries.
- Build an incremental partition-aware load with validated late-change reconciliation.
- Evaluate an eligible materialized view or governed summary table for common aggregates.
- Design governed fact and dimension tables with explicit surrogate or business keys and grain.
Explanation
Correct Answer
A:Evaluate a nested repeated line-item representation and write correct UNNEST queries. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A test report counts orders and line items correctly without multiplying unrelated measures. BigQuery nested and repeated fields can model appropriate one-to-many analytical relationships with fewer joins.
Incorrect Answers
B:Build an incremental partition-aware load with validated late-change reconciliation. This addresses a different situation: A daily fact table receives corrections, but each load recomputes every historical year and causes excessive query cost. The current scenario instead calls for the more directly applicable engineering action: Evaluate a nested repeated line-item representation and write correct UNNEST queries. The reason is that bigQuery nested and repeated fields can model appropriate one-to-many analytical relationships with fewer joins.
C:Evaluate an eligible materialized view or governed summary table for common aggregates. This addresses a different situation: A popular dashboard repeatedly computes the same large daily summary with strict latency goals, while raw transactional records remain necessary for detail drill-down. The current scenario instead calls for the more directly applicable engineering action: Evaluate a nested repeated line-item representation and write correct UNNEST queries. The reason is that bigQuery nested and repeated fields can model appropriate one-to-many analytical relationships with fewer joins.
D:Design governed fact and dimension tables with explicit surrogate or business keys and grain. This addresses a different situation: A retailer mixes orders, customers, products, and daily inventory measures in one wide duplicated table, making every report join and aggregate inconsistently. The current scenario instead calls for the more directly applicable engineering action: Evaluate a nested repeated line-item representation and write correct UNNEST queries. The reason is that bigQuery nested and repeated fields can model appropriate one-to-many analytical relationships with fewer joins.
Question 626
A Google Cloud data engineer is addressing: A payments stream retries messages after transient failures, causing duplicate warehouse revenue rows during replay. Which TWO complementary actions should the team take? Select TWO answers.
- Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics.
- Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window.
- Declare required upstream dependencies and freshness checks before downstream materialization.
- Review transaction boundaries, read-write patterns, recovery guarantees, and candidate database capabilities.
- Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates.
Explanation
Correct Answers
A:Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics. This is the applicable diagnostic investigation. Its complementary step is: Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window. Together they address: At-least-once message delivery requires explicit idempotency and stable event identity in downstream processing.
B:Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window. This is the applicable controlled engineering response. Its complementary step is: Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics. Together they address: At-least-once message delivery requires explicit idempotency and stable event identity in downstream processing.
Incorrect Answers
C:Declare required upstream dependencies and freshness checks before downstream materialization. This could be useful for another system: A Dataform pipeline materializes monthly revenue before its upstream exchange-rate table refresh completes. For this situation, the necessary paired decisions are to examine (Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics.) and to implement (Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window.).
D:Review transaction boundaries, read-write patterns, recovery guarantees, and candidate database capabilities. This could be useful for another system: An order service needs multi-row transactional correctness, yet engineers propose independent uncoordinated object writes as the system of record. For this situation, the necessary paired decisions are to examine (Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics.) and to implement (Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window.).
E:Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates. This could be useful for another system: A nightly sales feed occasionally omits required currency codes, but the current BigQuery load marks every run successful. For this situation, the necessary paired decisions are to examine (Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics.) and to implement (Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window.).
Question 627
Before modifying the data platform, the team observes: A reporting team creates a materialized view but expects it to instantaneously reflect every base-table update under all query patterns. Which evidence should the engineer examine FIRST?
- Inspect SQL construction, parameter values, connector authorization, and query errors.
- Review query execution stages, joins, ORDER BY, LIMIT, and slot usage.
- Inspect view definition, refresh status, source mutation rates, and query execution plans.
- Inspect dataset grants, policy tags, masking roles, and existing report queries.
Explanation
Correct Answer
C:Inspect view definition, refresh status, source mutation rates, and query execution plans. This evidence directly tests the uncertain part of the described system. Materialized views have supported eligibility and freshness behavior that must be understood. A controlled response is: Design an eligible materialized aggregation and define an acceptable freshness contract.
Incorrect Answers
A:Inspect SQL construction, parameter values, connector authorization, and query errors. This addresses a different situation: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. The current scenario instead calls for the more directly applicable investigation: Inspect view definition, refresh status, source mutation rates, and query execution plans. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
B:Review query execution stages, joins, ORDER BY, LIMIT, and slot usage. This addresses a different situation: An analytics query sorts a multi-terabyte table globally before returning 20 leaderboard entries, exhausting resources. The current scenario instead calls for the more directly applicable investigation: Inspect view definition, refresh status, source mutation rates, and query execution plans. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
D:Inspect dataset grants, policy tags, masking roles, and existing report queries. This addresses a different situation: Analysts need aggregate insurance-risk reporting while only authorized reviewers may see exact claimant identifiers. The current scenario instead calls for the more directly applicable investigation: Inspect view definition, refresh status, source mutation rates, and query execution plans. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
Question 628
The data engineering team must correct this issue: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. Which controlled engineering action is MOST appropriate?
- Publish a tested parameterized template with approved environment configuration.
- Use a suitable Google Cloud Workflows definition for the small stateful service chain.
- Move scheduled execution to an approved service identity or supported transfer owner with monitoring.
- Implement a governed backfill workflow with bounded concurrent writes and reconciliation.
Explanation
Correct Answer
D:Implement a governed backfill workflow with bounded concurrent writes and reconciliation. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A scheduled incremental run cannot corrupt or overwrite an actively backfilled partition. Backfill orchestration needs controlled concurrency and partition-level change coordination.
Incorrect Answers
A:Publish a tested parameterized template with approved environment configuration. This addresses a different situation: The same Dataflow template should run in staging and production but contains hardcoded staging bucket names and service-account references. The current scenario instead calls for the more directly applicable engineering action: Implement a governed backfill workflow with bounded concurrent writes and reconciliation. The reason is that backfill orchestration needs controlled concurrency and partition-level change coordination.
B:Use a suitable Google Cloud Workflows definition for the small stateful service chain. This addresses a different situation: A lightweight pipeline calls several managed service APIs in order with retry rules, but the team proposes maintaining an entire Airflow deployment for one request chain. The current scenario instead calls for the more directly applicable engineering action: Implement a governed backfill workflow with bounded concurrent writes and reconciliation. The reason is that backfill orchestration needs controlled concurrency and partition-level change coordination.
C:Move scheduled execution to an approved service identity or supported transfer owner with monitoring. This addresses a different situation: A recurring transformation runs under the credentials of a departed analyst and begins failing when the account is disabled. The current scenario instead calls for the more directly applicable engineering action: Implement a governed backfill workflow with bounded concurrent writes and reconciliation. The reason is that backfill orchestration needs controlled concurrency and partition-level change coordination.
Question 629
A Google Cloud data engineer is addressing: A daily fact table receives corrections, but each load recomputes every historical year and causes excessive query cost. Which TWO complementary actions should the team take? Select TWO answers.
- Review source change history, effective timestamps, invoice event times, and model grain.
- Review query job priority, resource contention, reservation design, and BI deadlines.
- Inspect frequent aggregations, dashboard latency, update frequency, and BigQuery feature support.
- Build an incremental partition-aware load with validated late-change reconciliation.
- Inspect change-watermarks, partition dates, correction frequency, and merge costs.
Explanation
Correct Answers
D:Build an incremental partition-aware load with validated late-change reconciliation. This is the applicable controlled engineering response. Its complementary step is: Inspect change-watermarks, partition dates, correction frequency, and merge costs. Together they address: Incremental transformations should process only changed partitions where correctness permits.
E:Inspect change-watermarks, partition dates, correction frequency, and merge costs. This is the applicable diagnostic investigation. Its complementary step is: Build an incremental partition-aware load with validated late-change reconciliation. Together they address: Incremental transformations should process only changed partitions where correctness permits.
Incorrect Answers
A:Review source change history, effective timestamps, invoice event times, and model grain. This could be useful for another system: Customer account tiers change over time but year-old invoices must be reported using the tier effective at the invoice date. For this situation, the necessary paired decisions are to examine (Inspect change-watermarks, partition dates, correction frequency, and merge costs.) and to implement (Build an incremental partition-aware load with validated late-change reconciliation.).
B:Review query job priority, resource contention, reservation design, and BI deadlines. This could be useful for another system: Interactive analysts share BigQuery capacity with long overnight transformations, causing unpredictable daytime dashboard latencies. For this situation, the necessary paired decisions are to examine (Inspect change-watermarks, partition dates, correction frequency, and merge costs.) and to implement (Build an incremental partition-aware load with validated late-change reconciliation.).
C:Inspect frequent aggregations, dashboard latency, update frequency, and BigQuery feature support. This could be useful for another system: A popular dashboard repeatedly computes the same large daily summary with strict latency goals, while raw transactional records remain necessary for detail drill-down. For this situation, the necessary paired decisions are to examine (Inspect change-watermarks, partition dates, correction frequency, and merge costs.) and to implement (Build an incremental partition-aware load with validated late-change reconciliation.).
Question 630
The data engineering team must correct this issue: A daily pipeline fails across multiple microservices, but logs cannot connect the initial import to the final BigQuery job. Which controlled engineering action is MOST appropriate?
- Alert on sustained lack of event-time progress and remediate the blocking stage.
- Propagate stable pipeline-run identifiers through logs, jobs, and metrics.
- Configure monitored assertions that block certification and alert accountable data owners.
- Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck.
Explanation
Correct Answer
B:Propagate stable pipeline-run identifiers through logs, jobs, and metrics. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: One failed sample run can be traced from source receipt to the failing transformation. End-to-end observability needs stable correlation identifiers and structured telemetry.
Incorrect Answers
A:Alert on sustained lack of event-time progress and remediate the blocking stage. This addresses a different situation: A stream's reported job state stays Running while the actual consumer watermark stops moving for twenty minutes. The current scenario instead calls for the more directly applicable engineering action: Propagate stable pipeline-run identifiers through logs, jobs, and metrics. The reason is that end-to-end observability needs stable correlation identifiers and structured telemetry.
C:Configure monitored assertions that block certification and alert accountable data owners. This addresses a different situation: An automated Dataform transform completes, but one critical assertion reports failed rows and no team is notified. The current scenario instead calls for the more directly applicable engineering action: Propagate stable pipeline-run identifiers through logs, jobs, and metrics. The reason is that end-to-end observability needs stable correlation identifiers and structured telemetry.
D:Refactor the identified heavy stage or adjust supported capacity after explaining the bottleneck. This addresses a different situation: A large BigQuery query fails with resources-exceeded errors and the operator sees only a generic dashboard red indicator. The current scenario instead calls for the more directly applicable engineering action: Propagate stable pipeline-run identifiers through logs, jobs, and metrics. The reason is that end-to-end observability needs stable correlation identifiers and structured telemetry.