Google Professional Data Engineer Practice Test 55
Question 540
The data engineering team must correct this issue: Datastream CDC events sometimes reach the destination out of order after reconnection and older rows overwrite current values. Which controlled engineering action is MOST appropriate?
- Redesign the aggregation key or introduce valid fan-out patterns where supported.
- Define product IDs as string fields and validate source formats before BigQuery loading.
- Apply CDC changes using reliable source sequence/version ordering with replay safeguards.
- Configure Apache Beam windows and late-data handling appropriate to the report contract.
Explanation
Correct Answer
C:Apply CDC changes using reliable source sequence/version ordering with replay safeguards. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: An injected delayed older update cannot replace the latest committed source state. CDC processing must respect source transaction order or version markers.
Incorrect Answers
A:Redesign the aggregation key or introduce valid fan-out patterns where supported. This addresses a different situation: A Dataflow group-by-key stage slows because almost all events share one constant grouping value. The current scenario instead calls for the more directly applicable engineering action: Apply CDC changes using reliable source sequence/version ordering with replay safeguards. The reason is that cDC processing must respect source transaction order or version markers.
B:Define product IDs as string fields and validate source formats before BigQuery loading. This addresses a different situation: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. The current scenario instead calls for the more directly applicable engineering action: Apply CDC changes using reliable source sequence/version ordering with replay safeguards. The reason is that cDC processing must respect source transaction order or version markers.
D:Configure Apache Beam windows and late-data handling appropriate to the report contract. This addresses a different situation: A fraud model groups purchases into ten-minute windows, but late device clocks place events into the wrong billing period. The current scenario instead calls for the more directly applicable engineering action: Apply CDC changes using reliable source sequence/version ordering with replay safeguards. The reason is that cDC processing must respect source transaction order or version markers.
Question 541
After applying the change, the team re-examines this condition: A company lands vendor extracts directly in curated datasets, making it impossible to distinguish unvalidated source values from approved metrics. Which result BEST verifies the improvement?
- A representative transform can run in a second approved environment with predictable adjustments.
- A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics.
- A representative scaled load meets freshness and query objectives without changing dashboard contracts.
- Users can identify the certified retention dataset and its upstream systems without guessing.
Explanation
Correct Answer
B:A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Define governed staging and curated data layers with controlled promotion checks. Raw, validated, and curated layers clarify ownership, quality, and reproducibility.
Incorrect Answers
A:A representative transform can run in a second approved environment with predictable adjustments. This addresses a different situation: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. The current scenario instead calls for the more directly applicable verification result: A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics. The reason is that raw, validated, and curated layers clarify ownership, quality, and reproducibility.
C:A representative scaled load meets freshness and query objectives without changing dashboard contracts. This addresses a different situation: A pilot warehouse handles thousands of daily events but must support hundreds of millions without rewriting every consuming dashboard. The current scenario instead calls for the more directly applicable verification result: A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics. The reason is that raw, validated, and curated layers clarify ownership, quality, and reproducibility.
D:Users can identify the certified retention dataset and its upstream systems without guessing. This addresses a different situation: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. The current scenario instead calls for the more directly applicable verification result: A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics. The reason is that raw, validated, and curated layers clarify ownership, quality, and reproducibility.
Question 542
The data engineering team must correct this issue: A fraud model groups purchases into ten-minute windows, but late device clocks place events into the wrong billing period. Which controlled engineering action is MOST appropriate?
- Add structured error outputs and fail or quarantine according to the data contract.
- Tune adaptive execution and partitions or repartition skewed keys according to the workload.
- Configure Apache Beam windows and late-data handling appropriate to the report contract.
- Build an approved Cloud Data Fusion pipeline with validated source mappings and target schema.
Explanation
Correct Answer
C:Configure Apache Beam windows and late-data handling appropriate to the report contract. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A deliberately late event updates or is routed according to the documented window policy. Event-time processing requires explicit windowing, watermarks, allowed lateness, and correction behavior.
Incorrect Answers
A:Add structured error outputs and fail or quarantine according to the data contract. This addresses a different situation: A Dataflow JavaScript or Python user-defined transform catches every exception and returns an empty record, hiding thousands of failed rows. The current scenario instead calls for the more directly applicable engineering action: Configure Apache Beam windows and late-data handling appropriate to the report contract. The reason is that event-time processing requires explicit windowing, watermarks, allowed lateness, and correction behavior.
B:Tune adaptive execution and partitions or repartition skewed keys according to the workload. This addresses a different situation: A Dataproc Spark batch shuffles terabytes into a handful of very large partitions and regularly runs out of memory. The current scenario instead calls for the more directly applicable engineering action: Configure Apache Beam windows and late-data handling appropriate to the report contract. The reason is that event-time processing requires explicit windowing, watermarks, allowed lateness, and correction behavior.
D:Build an approved Cloud Data Fusion pipeline with validated source mappings and target schema. This addresses a different situation: A team has several supported relational sources and needs standard cleansing workflows but maintains dozens of brittle custom extraction scripts. The current scenario instead calls for the more directly applicable engineering action: Configure Apache Beam windows and late-data handling appropriate to the report contract. The reason is that event-time processing requires explicit windowing, watermarks, allowed lateness, and correction behavior.
Question 543
A Google Cloud architecture review finds: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. Which principle BEST explains the underlying data-engineering risk?
- Future scale requirements must influence partitioning, decoupling, and managed resource choices.
- Deployment portability requires parameterized environment-specific resources and validated locations.
- Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
- Cataloging and lineage metadata support discoverability, stewardship, and trusted reuse.
Explanation
Correct Answer
D:Cataloging and lineage metadata support discoverability, stewardship, and trusted reuse. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inventory datasets, owners, classifications, descriptions, and upstream-downstream dependencies. A focused corrective action is: Register curated assets in an approved catalog with owners, business definitions, and lineage.
Incorrect Answers
A:Future scale requirements must influence partitioning, decoupling, and managed resource choices. This addresses a different situation: A pilot warehouse handles thousands of daily events but must support hundreds of millions without rewriting every consuming dashboard. The current scenario instead calls for the more directly applicable principle: Cataloging and lineage metadata support discoverability, stewardship, and trusted reuse. The reason is that cataloging and lineage metadata support discoverability, stewardship, and trusted reuse.
B:Deployment portability requires parameterized environment-specific resources and validated locations. This addresses a different situation: A pipeline deployment hardcodes one project ID and dataset location into every query, blocking deployment into another approved region. The current scenario instead calls for the more directly applicable principle: Cataloging and lineage metadata support discoverability, stewardship, and trusted reuse. The reason is that cataloging and lineage metadata support discoverability, stewardship, and trusted reuse.
C:Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries. This addresses a different situation: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. The current scenario instead calls for the more directly applicable principle: Cataloging and lineage metadata support discoverability, stewardship, and trusted reuse. The reason is that cataloging and lineage metadata support discoverability, stewardship, and trusted reuse.
Question 544
A design review evaluates this situation: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. Which shortcut should the team MOST specifically avoid?
- Publish unnamed raw tables and assume storage folder names explain all semantics.
- Claim multi-cloud portability because an undocumented console job can be recreated by memory.
- Make incoming third-party files immediately indistinguishable from certified data.
- Edit arbitrary SQL strings manually after each deployment and omit configuration review.
Explanation
Correct Answer
B:Claim multi-cloud portability because an undocumented console job can be recreated by memory. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Separate portable transformation logic from provider-specific orchestration and version the deployment configuration. Why: Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
Incorrect Answers
A:Publish unnamed raw tables and assume storage folder names explain all semantics. This addresses a different situation: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. The current scenario instead calls for the more directly applicable unsafe shortcut: Claim multi-cloud portability because an undocumented console job can be recreated by memory. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
C:Make incoming third-party files immediately indistinguishable from certified data. This addresses a different situation: A company lands vendor extracts directly in curated datasets, making it impossible to distinguish unvalidated source values from approved metrics. The current scenario instead calls for the more directly applicable unsafe shortcut: Claim multi-cloud portability because an undocumented console job can be recreated by memory. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
D:Edit arbitrary SQL strings manually after each deployment and omit configuration review. This addresses a different situation: A pipeline deployment hardcodes one project ID and dataset location into every query, blocking deployment into another approved region. The current scenario instead calls for the more directly applicable unsafe shortcut: Claim multi-cloud portability because an undocumented console job can be recreated by memory. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
Question 545
A Google Cloud data engineer is addressing: An enterprise migrates a high-write transactional database to Google Cloud and cannot afford a long source freeze during cutover. Which TWO complementary actions should the team take? Select TWO answers.
- Run field-level and aggregate reconciliation with tolerances defined by financial owners.
- Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies.
- Inspect source database capabilities, replication lag, schema compatibility, and cutover windows.
- Use a supported Database Migration Service path and a rehearsed switchover with reconciliation.
- Measure data size, network capacity, security policy, available time, and checksum requirements.
Explanation
Correct Answers
C:Inspect source database capabilities, replication lag, schema compatibility, and cutover windows. This is the applicable diagnostic investigation. Its complementary step is: Use a supported Database Migration Service path and a rehearsed switchover with reconciliation. Together they address: Low-downtime database migration needs ongoing change capture, validation, and controlled application switchover.
D:Use a supported Database Migration Service path and a rehearsed switchover with reconciliation. This is the applicable controlled engineering response. Its complementary step is: Inspect source database capabilities, replication lag, schema compatibility, and cutover windows. Together they address: Low-downtime database migration needs ongoing change capture, validation, and controlled application switchover.
Incorrect Answers
A:Run field-level and aggregate reconciliation with tolerances defined by financial owners. This could be useful for another system: A historical financial ledger migration matches table row counts but contains changed decimal precision in several high-value transactions. For this situation, the necessary paired decisions are to examine (Inspect source database capabilities, replication lag, schema compatibility, and cutover windows.) and to implement (Use a supported Database Migration Service path and a rehearsed switchover with reconciliation.).
B:Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies. This could be useful for another system: A batch Hadoop estate has custom Spark jobs and HDFS storage tightly coupled to aging servers. For this situation, the necessary paired decisions are to examine (Inspect source database capabilities, replication lag, schema compatibility, and cutover windows.) and to implement (Use a supported Database Migration Service path and a rehearsed switchover with reconciliation.).
E:Measure data size, network capacity, security policy, available time, and checksum requirements. This could be useful for another system: A research institute has hundreds of terabytes on isolated storage and cannot upload the first copy within its migration window. For this situation, the necessary paired decisions are to examine (Inspect source database capabilities, replication lag, schema compatibility, and cutover windows.) and to implement (Use a supported Database Migration Service path and a rehearsed switchover with reconciliation.).
Question 546
After applying the change, the team re-examines this condition: A team has several supported relational sources and needs standard cleansing workflows but maintains dozens of brittle custom extraction scripts. Which result BEST verifies the improvement?
- A representative heavy-key workload scales without one worker dominating processing time.
- A sample source change is ingested and transformed consistently without manual code edits.
- An imported product code retains its original leading zeros and joins to the reference dimension.
- Running the same batch twice yields identical final customer records and aggregate totals.
Explanation
Correct Answer
B:A sample source change is ingested and transformed consistently without manual code edits. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Build an approved Cloud Data Fusion pipeline with validated source mappings and target schema. Managed integration tools can simplify source connectivity and repeatable mappings when requirements fit.
Incorrect Answers
A:A representative heavy-key workload scales without one worker dominating processing time. This addresses a different situation: A Dataflow group-by-key stage slows because almost all events share one constant grouping value. The current scenario instead calls for the more directly applicable verification result: A sample source change is ingested and transformed consistently without manual code edits. The reason is that managed integration tools can simplify source connectivity and repeatable mappings when requirements fit.
C:An imported product code retains its original leading zeros and joins to the reference dimension. This addresses a different situation: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. The current scenario instead calls for the more directly applicable verification result: A sample source change is ingested and transformed consistently without manual code edits. The reason is that managed integration tools can simplify source connectivity and repeatable mappings when requirements fit.
D:Running the same batch twice yields identical final customer records and aggregate totals. This addresses a different situation: A nightly BigQuery MERGE job occasionally reruns after an orchestrator timeout and inserts duplicate business keys. The current scenario instead calls for the more directly applicable verification result: A sample source change is ingested and transformed consistently without manual code edits. The reason is that managed integration tools can simplify source connectivity and repeatable mappings when requirements fit.
Question 547
A Google Cloud architecture review finds: An internal ERP system sends sensitive database extracts to Google Cloud but security rules prohibit unrestricted internet endpoints. Which principle BEST explains the underlying data-engineering risk?
- Ingestion networking and encryption must align with connectivity and trust boundaries.
- Processing mode should reflect data freshness requirements and operating cost.
- Decoupled messaging can buffer variable event rates and isolate independent consumers.
- Ordering requirements must be explicit, scoped, and supported by the message architecture.
Explanation
Correct Answer
A:Ingestion networking and encryption must align with connectivity and trust boundaries. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect source network route, private connectivity options, service endpoints, and authentication. A focused corrective action is: Design an approved private or restricted connection with encrypted transfer and scoped workload identity.
Incorrect Answers
B:Processing mode should reflect data freshness requirements and operating cost. This addresses a different situation: A monthly tax report is generated once per period, but architects propose a continuously running expensive streaming engine. The current scenario instead calls for the more directly applicable principle: Ingestion networking and encryption must align with connectivity and trust boundaries. The reason is that ingestion networking and encryption must align with connectivity and trust boundaries.
C:Decoupled messaging can buffer variable event rates and isolate independent consumers. This addresses a different situation: Thousands of store devices publish small events unpredictably, and downstream systems must process them independently without blocking publishers. The current scenario instead calls for the more directly applicable principle: Ingestion networking and encryption must align with connectivity and trust boundaries. The reason is that ingestion networking and encryption must align with connectivity and trust boundaries.
D:Ordering requirements must be explicit, scoped, and supported by the message architecture. This addresses a different situation: A product team requires per-customer event ordering but distributes all messages without a stable key and assumes total ordering across workers. The current scenario instead calls for the more directly applicable principle: Ingestion networking and encryption must align with connectivity and trust boundaries. The reason is that ingestion networking and encryption must align with connectivity and trust boundaries.
Question 548
Before modifying the data platform, the team observes: A research lake contains both public scientific data and restricted patient samples under one bucket with unrestricted reader roles. Which evidence should the engineer examine FIRST?
- Inspect average object size, file counts, partition layout, and scan timings.
- Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories.
- Inventory object prefixes, formats, source owners, and data classification.
- Inspect object locations, bucket IAM, table controls, and data classifications.
Explanation
Correct Answer
D:Inspect object locations, bucket IAM, table controls, and data classifications. This evidence directly tests the uncertain part of the described system. Lake security should enforce data-domain access and classification boundaries. A controlled response is: Create segregated governed storage or lake access policies with least-privilege permissions.
Incorrect Answers
A:Inspect average object size, file counts, partition layout, and scan timings. This addresses a different situation: A Spark job writes millions of tiny Parquet objects, causing large listing overhead and poor query performance across the lake. The current scenario instead calls for the more directly applicable investigation: Inspect object locations, bucket IAM, table controls, and data classifications. The reason is that lake security should enforce data-domain access and classification boundaries.
B:Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. This addresses a different situation: A data lake ingestion job repeatedly misses one daily source partition yet storage dashboards show only total object count. The current scenario instead calls for the more directly applicable investigation: Inspect object locations, bucket IAM, table controls, and data classifications. The reason is that lake security should enforce data-domain access and classification boundaries.
C:Inventory object prefixes, formats, source owners, and data classification. This addresses a different situation: Researchers place thousands of raw objects in a data lake and cannot identify schemas, ownership, or classification. The current scenario instead calls for the more directly applicable investigation: Inspect object locations, bucket IAM, table controls, and data classifications. The reason is that lake security should enforce data-domain access and classification boundaries.
Question 549
After applying the change, the team re-examines this condition: A reporting table is updated from multiple partners, and records arriving days late overwrite newer authoritative versions. Which result BEST verifies the improvement?
- A deliberately interrupted order update cannot leave mutually inconsistent committed rows.
- An injected worker failure recovers processing without missing or double-counting committed events.
- Replaying the same business event does not increase recognized revenue a second time.
- A late stale update cannot replace a newer approved customer record.
Explanation
Correct Answer
D:A late stale update cannot replace a newer approved customer record. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Implement version-aware merges with authoritative ordering and an auditable correction pathway. Data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
Incorrect Answers
A:A deliberately interrupted order update cannot leave mutually inconsistent committed rows. This addresses a different situation: An order service needs multi-row transactional correctness, yet engineers propose independent uncoordinated object writes as the system of record. The current scenario instead calls for the more directly applicable verification result: A late stale update cannot replace a newer approved customer record. The reason is that data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
B:An injected worker failure recovers processing without missing or double-counting committed events. This addresses a different situation: A six-hour streaming Dataflow job is relaunched after worker failure and loses uncommitted state when operators create a new pipeline without recovery planning. The current scenario instead calls for the more directly applicable verification result: A late stale update cannot replace a newer approved customer record. The reason is that data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
C:Replaying the same business event does not increase recognized revenue a second time. This addresses a different situation: A payments stream retries messages after transient failures, causing duplicate warehouse revenue rows during replay. The current scenario instead calls for the more directly applicable verification result: A late stale update cannot replace a newer approved customer record. The reason is that data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
Question 550
A Google Cloud architecture review finds: A data lake ingestion job repeatedly misses one daily source partition yet storage dashboards show only total object count. Which principle BEST explains the underlying data-engineering risk?
- Lake operational monitoring needs partition completeness and business-level freshness signals.
- Data lake ingestion benefits from schema contracts, validation, and curated layers.
- A useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage.
- Lake query performance depends on file sizing, layout, and processing format, not only total bytes.
Explanation
Correct Answer
A:Lake operational monitoring needs partition completeness and business-level freshness signals. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. A focused corrective action is: Implement per-source completeness checks with actionable missing-partition alerts.
Incorrect Answers
B:Data lake ingestion benefits from schema contracts, validation, and curated layers. This addresses a different situation: Multiple departments publish raw JSON to a shared lake with inconsistent field definitions that break downstream reusable tables. The current scenario instead calls for the more directly applicable principle: Lake operational monitoring needs partition completeness and business-level freshness signals. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.
C:A useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage. This addresses a different situation: Researchers place thousands of raw objects in a data lake and cannot identify schemas, ownership, or classification. The current scenario instead calls for the more directly applicable principle: Lake operational monitoring needs partition completeness and business-level freshness signals. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.
D:Lake query performance depends on file sizing, layout, and processing format, not only total bytes. This addresses a different situation: A Spark job writes millions of tiny Parquet objects, causing large listing overhead and poor query performance across the lake. The current scenario instead calls for the more directly applicable principle: Lake operational monitoring needs partition completeness and business-level freshness signals. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.