Google Professional Data Engineer Practice Test 34
Question 330
After applying the change, the team re-examines this condition: A content pipeline sends customer free-text support tickets to a generative model for categorization without excluding sensitive identifiers. Which result BEST verifies the improvement?
- Running the same batch twice yields identical final customer records and aggregate totals.
- Malformed events are quarantined with traceable context while valid events continue.
- A seeded sensitive ticket is handled under policy while its label is accurate enough for downstream use.
- An event without an initial reference is retried or quarantined according to contract rather than silently dropped.
Explanation
Correct Answer
C:A seeded sensitive ticket is handled under policy while its label is accurate enough for downstream use. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: De-identify permitted fields and apply reviewed model categorization with validation and restricted output. AI-assisted enrichment must enforce input governance, data minimization, and output validation.
Incorrect Answers
A:Running the same batch twice yields identical final customer records and aggregate totals. This addresses a different situation: A nightly BigQuery MERGE job occasionally reruns after an orchestrator timeout and inserts duplicate business keys. The current scenario instead calls for the more directly applicable verification result: A seeded sensitive ticket is handled under policy while its label is accurate enough for downstream use. The reason is that aI-assisted enrichment must enforce input governance, data minimization, and output validation.
B:Malformed events are quarantined with traceable context while valid events continue. This addresses a different situation: Poison messages repeatedly fail subscriber parsing, preventing healthy telemetry events from moving through the subscription. The current scenario instead calls for the more directly applicable verification result: A seeded sensitive ticket is handled under policy while its label is accurate enough for downstream use. The reason is that aI-assisted enrichment must enforce input governance, data minimization, and output validation.
D:An event without an initial reference is retried or quarantined according to contract rather than silently dropped. This addresses a different situation: Device readings arrive every second but the related factory equipment registration data changes hourly, producing joins with missing references. The current scenario instead calls for the more directly applicable verification result: A seeded sensitive ticket is handled under policy while its label is accurate enough for downstream use. The reason is that aI-assisted enrichment must enforce input governance, data minimization, and output validation.
Question 331
After applying the change, the team re-examines this condition: A retail database migration captures historical tables but fails to process updates made after the initial snapshot. Which result BEST verifies the improvement?
- A test mutation during backfill appears once in the destination after catch-up.
- A manifest confirms transferred object counts and checksums within the cutover window.
- A file modified during migration is represented at its intended final version exactly once.
- Post-cutover row and transaction checks agree and application downtime meets its objective.
Explanation
Correct Answer
A:A test mutation during backfill appears once in the destination after catch-up. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Configure supported Datastream change capture with consistent backfill and lag monitoring. Snapshot backfill and ongoing change-data capture must converge without gaps or double application.
Incorrect Answers
B:A manifest confirms transferred object counts and checksums within the cutover window. This addresses a different situation: A research institute has hundreds of terabytes on isolated storage and cannot upload the first copy within its migration window. The current scenario instead calls for the more directly applicable verification result: A test mutation during backfill appears once in the destination after catch-up. The reason is that snapshot backfill and ongoing change-data capture must converge without gaps or double application.
C:A file modified during migration is represented at its intended final version exactly once. This addresses a different situation: A partner shares daily updates while an organization copies older archives into a new Cloud Storage lake. The current scenario instead calls for the more directly applicable verification result: A test mutation during backfill appears once in the destination after catch-up. The reason is that snapshot backfill and ongoing change-data capture must converge without gaps or double application.
D:Post-cutover row and transaction checks agree and application downtime meets its objective. This addresses a different situation: An enterprise migrates a high-write transactional database to Google Cloud and cannot afford a long source freeze during cutover. The current scenario instead calls for the more directly applicable verification result: A test mutation during backfill appears once in the destination after catch-up. The reason is that snapshot backfill and ongoing change-data capture must converge without gaps or double application.
Question 332
Before modifying the data platform, the team observes: A payments stream retries messages after transient failures, causing duplicate warehouse revenue rows during replay. Which evidence should the engineer examine FIRST?
- Inspect job state, checkpoints, replay source retention, watermarks, and sink write behavior.
- Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics.
- Review source schema, null rates, accepted values, and downstream financial calculations.
- Review RPO/RTO requirements, region dependencies, replication design, and backup restoration tests.
Explanation
Correct Answer
B:Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics. This evidence directly tests the uncertain part of the described system. At-least-once message delivery requires explicit idempotency and stable event identity in downstream processing. A controlled response is: Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window.
Incorrect Answers
A:Inspect job state, checkpoints, replay source retention, watermarks, and sink write behavior. This addresses a different situation: A six-hour streaming Dataflow job is relaunched after worker failure and loses uncommitted state when operators create a new pipeline without recovery planning. The current scenario instead calls for the more directly applicable investigation: Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics. The reason is that at-least-once message delivery requires explicit idempotency and stable event identity in downstream processing.
C:Review source schema, null rates, accepted values, and downstream financial calculations. This addresses a different situation: A nightly sales feed occasionally omits required currency codes, but the current BigQuery load marks every run successful. The current scenario instead calls for the more directly applicable investigation: Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics. The reason is that at-least-once message delivery requires explicit idempotency and stable event identity in downstream processing.
D:Review RPO/RTO requirements, region dependencies, replication design, and backup restoration tests. This addresses a different situation: A regional processing failure stops daily regulatory datasets because all staging, computation, and recovery copies reside in one failure domain. The current scenario instead calls for the more directly applicable investigation: Inspect Pub/Sub message identifiers, producer event IDs, write keys, and duplicate metrics. The reason is that at-least-once message delivery requires explicit idempotency and stable event identity in downstream processing.
Question 333
The data engineering team must correct this issue: A platform has existing Kafka producers and needs to introduce cloud analytics without rewriting every producer immediately. Which controlled engineering action is MOST appropriate?
- Redesign the aggregation key or introduce valid fan-out patterns where supported.
- Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution.
- Tune Dataflow worker limits and pipeline stages using measured bottlenecks.
- Adopt a supported Kafka-to-Google Cloud ingestion connector or bridge with measured delivery guarantees.
Explanation
Correct Answer
D:Adopt a supported Kafka-to-Google Cloud ingestion connector or bridge with measured delivery guarantees. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A producer event is available to the approved cloud consumer without changing producer behavior. Integration choice should preserve existing event semantics while decoupling cloud consumers.
Incorrect Answers
A:Redesign the aggregation key or introduce valid fan-out patterns where supported. This addresses a different situation: A Dataflow group-by-key stage slows because almost all events share one constant grouping value. The current scenario instead calls for the more directly applicable engineering action: Adopt a supported Kafka-to-Google Cloud ingestion connector or bridge with measured delivery guarantees. The reason is that integration choice should preserve existing event semantics while decoupling cloud consumers.
B:Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution. This addresses a different situation: A once-weekly Spark transformation uses a permanently running Dataproc cluster that sits idle most of the week. The current scenario instead calls for the more directly applicable engineering action: Adopt a supported Kafka-to-Google Cloud ingestion connector or bridge with measured delivery guarantees. The reason is that integration choice should preserve existing event semantics while decoupling cloud consumers.
C:Tune Dataflow worker limits and pipeline stages using measured bottlenecks. This addresses a different situation: During a marketing campaign, Pub/Sub backlog grows and Dataflow workers remain fixed far below incoming throughput. The current scenario instead calls for the more directly applicable engineering action: Adopt a supported Kafka-to-Google Cloud ingestion connector or bridge with measured delivery guarantees. The reason is that integration choice should preserve existing event semantics while decoupling cloud consumers.
Question 334
A Google Cloud data engineer is addressing: Poison messages repeatedly fail subscriber parsing, preventing healthy telemetry events from moving through the subscription. Which TWO complementary actions should the team take? Select TWO answers.
- Configure an approved dead-letter topic and remediation workflow with appropriate retry policy.
- Add structured error outputs and fail or quarantine according to the data contract.
- Compare connector support, transformations, secret storage, and execution SLAs.
- Inspect delivery attempt counts, error patterns, dead-letter configuration, and acknowledgements.
- Tune adaptive execution and partitions or repartition skewed keys according to the workload.
Explanation
Correct Answers
A:Configure an approved dead-letter topic and remediation workflow with appropriate retry policy. This is the applicable controlled engineering response. Its complementary step is: Inspect delivery attempt counts, error patterns, dead-letter configuration, and acknowledgements. Together they address: Invalid messages need bounded retry, quarantine, and replay decisions.
D:Inspect delivery attempt counts, error patterns, dead-letter configuration, and acknowledgements. This is the applicable diagnostic investigation. Its complementary step is: Configure an approved dead-letter topic and remediation workflow with appropriate retry policy. Together they address: Invalid messages need bounded retry, quarantine, and replay decisions.
Incorrect Answers
B:Add structured error outputs and fail or quarantine according to the data contract. This could be useful for another system: A Dataflow JavaScript or Python user-defined transform catches every exception and returns an empty record, hiding thousands of failed rows. For this situation, the necessary paired decisions are to examine (Inspect delivery attempt counts, error patterns, dead-letter configuration, and acknowledgements.) and to implement (Configure an approved dead-letter topic and remediation workflow with appropriate retry policy.).
C:Compare connector support, transformations, secret storage, and execution SLAs. This could be useful for another system: A team has several supported relational sources and needs standard cleansing workflows but maintains dozens of brittle custom extraction scripts. For this situation, the necessary paired decisions are to examine (Inspect delivery attempt counts, error patterns, dead-letter configuration, and acknowledgements.) and to implement (Configure an approved dead-letter topic and remediation workflow with appropriate retry policy.).
E:Tune adaptive execution and partitions or repartition skewed keys according to the workload. This could be useful for another system: A Dataproc Spark batch shuffles terabytes into a handful of very large partitions and regularly runs out of memory. For this situation, the necessary paired decisions are to examine (Inspect delivery attempt counts, error patterns, dead-letter configuration, and acknowledgements.) and to implement (Configure an approved dead-letter topic and remediation workflow with appropriate retry policy.).
Question 335
Before modifying the data platform, the team observes: An IoT pipeline joins fast sensor events to slowly changing asset ownership records and occasionally labels readings with obsolete owners. Which evidence should the engineer examine FIRST?
- Inspect object names, source timestamps, hash manifests, schemas, and duplicate deliveries.
- Review TLS requirements, authenticated endpoints, data classification, and bucket IAM.
- Measure arrival rates, message ordering requirements, retention, and subscriber service objectives.
- Inspect event timestamps, reference update cadence, join keys, and allowed staleness.
Explanation
Correct Answer
D:Inspect event timestamps, reference update cadence, join keys, and allowed staleness. This evidence directly tests the uncertain part of the described system. Stream enrichment requires a defined temporal join and lookup freshness contract. A controlled response is: Implement versioned reference lookups or temporal enrichment with explicit validity periods.
Incorrect Answers
A:Inspect object names, source timestamps, hash manifests, schemas, and duplicate deliveries. This addresses a different situation: Daily vendor deliveries contain multipart files with duplicate names and changing schemas, making ingestion traceability unreliable. The current scenario instead calls for the more directly applicable investigation: Inspect event timestamps, reference update cadence, join keys, and allowed staleness. The reason is that stream enrichment requires a defined temporal join and lookup freshness contract.
B:Review TLS requirements, authenticated endpoints, data classification, and bucket IAM. This addresses a different situation: A partner uploads raw customer records by custom API, but the team has not assessed encryption in transit or destination access. The current scenario instead calls for the more directly applicable investigation: Inspect event timestamps, reference update cadence, join keys, and allowed staleness. The reason is that stream enrichment requires a defined temporal join and lookup freshness contract.
C:Measure arrival rates, message ordering requirements, retention, and subscriber service objectives. This addresses a different situation: Thousands of store devices publish small events unpredictably, and downstream systems must process them independently without blocking publishers. The current scenario instead calls for the more directly applicable investigation: Inspect event timestamps, reference update cadence, join keys, and allowed staleness. The reason is that stream enrichment requires a defined temporal join and lookup freshness contract.
Question 336
A Google Cloud data engineer is addressing: A yearly backfill invokes all daily dependent tasks concurrently, while downstream aggregation assumes every day is already complete. Which TWO complementary actions should the team take? Select TWO answers.
- Create a parameterized backfill DAG with ordered readiness checks and bounded parallelism.
- Configure the intended time zone and test scheduled execution across relevant date transitions.
- Design tasks with stable run identifiers and safe retries or external deduplication.
- Inspect repository branch, compilation version, release configuration, and invocation logs.
- Examine task graph, partition completeness, retries, and downstream data freshness.
Explanation
Correct Answers
A:Create a parameterized backfill DAG with ordered readiness checks and bounded parallelism. This is the applicable controlled engineering response. Its complementary step is: Examine task graph, partition completeness, retries, and downstream data freshness. Together they address: Backfill workflows need dependency awareness and capacity controls.
E:Examine task graph, partition completeness, retries, and downstream data freshness. This is the applicable diagnostic investigation. Its complementary step is: Create a parameterized backfill DAG with ordered readiness checks and bounded parallelism. Together they address: Backfill workflows need dependency awareness and capacity controls.
Incorrect Answers
B:Configure the intended time zone and test scheduled execution across relevant date transitions. This could be useful for another system: A daily report must run at 08:00 business time, but the scheduler is configured in UTC and shifts unexpectedly after regional daylight changes. For this situation, the necessary paired decisions are to examine (Examine task graph, partition completeness, retries, and downstream data freshness.) and to implement (Create a parameterized backfill DAG with ordered readiness checks and bounded parallelism.).
C:Design tasks with stable run identifiers and safe retries or external deduplication. This could be useful for another system: An Airflow DAG reruns after scheduler recovery and reissues the same external billing update twice. For this situation, the necessary paired decisions are to examine (Examine task graph, partition completeness, retries, and downstream data freshness.) and to implement (Create a parameterized backfill DAG with ordered readiness checks and bounded parallelism.).
D:Inspect repository branch, compilation version, release configuration, and invocation logs. This could be useful for another system: A production ELT workflow pulls arbitrary local workspace changes without approvals, creating nondeterministic table definitions. For this situation, the necessary paired decisions are to examine (Examine task graph, partition completeness, retries, and downstream data freshness.) and to implement (Create a parameterized backfill DAG with ordered readiness checks and bounded parallelism.).
Question 337
A Google Cloud data engineer is addressing: An upstream vendor accidentally publishes a corrupted schema version and downstream totals become wrong before anyone notices. Which TWO complementary actions should the team take? Select TWO answers.
- Quarantine bad partitions and replay validated source data through controlled transformations.
- Develop a tested regional recovery workflow with replay controls and data reconciliation.
- Inspect affected partitions, ingestion manifests, validation history, and recovery sources.
- Review primary and replica roles, consistency modes, transaction commit paths, and failover configuration.
- Review availability configuration, application connection recovery, backups, and zone dependencies.
Explanation
Correct Answers
A:Quarantine bad partitions and replay validated source data through controlled transformations. This is the applicable controlled engineering response. Its complementary step is: Inspect affected partitions, ingestion manifests, validation history, and recovery sources. Together they address: Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
C:Inspect affected partitions, ingestion manifests, validation history, and recovery sources. This is the applicable diagnostic investigation. Its complementary step is: Quarantine bad partitions and replay validated source data through controlled transformations. Together they address: Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
Incorrect Answers
B:Develop a tested regional recovery workflow with replay controls and data reconciliation. This could be useful for another system: A critical Pub/Sub-to-warehouse flow has a secondary-region deployment template but no retained state, failover routing, or test exercise. For this situation, the necessary paired decisions are to examine (Inspect affected partitions, ingestion manifests, validation history, and recovery sources.) and to implement (Quarantine bad partitions and replay validated source data through controlled transformations.).
D:Review primary and replica roles, consistency modes, transaction commit paths, and failover configuration. This could be useful for another system: An application routes financial writes to a stale read replica after primary failure, returning success before records are durably committed. For this situation, the necessary paired decisions are to examine (Inspect affected partitions, ingestion manifests, validation history, and recovery sources.) and to implement (Quarantine bad partitions and replay validated source data through controlled transformations.).
E:Review availability configuration, application connection recovery, backups, and zone dependencies. This could be useful for another system: A production relational data source resides on a single-zone Cloud SQL instance and a zone outage stops all ingestion. For this situation, the necessary paired decisions are to examine (Inspect affected partitions, ingestion manifests, validation history, and recovery sources.) and to implement (Quarantine bad partitions and replay validated source data through controlled transformations.).
Question 338
The data engineering team must correct this issue: An embedded dashboard lets viewers export all underlying data even though contracts permit only monthly aggregates. Which controlled engineering action is MOST appropriate?
- Apply supported row access policies or governed authorized views with tenant controls.
- Restrict report export and underlying dataset grants consistent with approved aggregate-only access.
- Publish a controlled BigQuery sharing listing and grant only approved subscriber access.
- Create a controlled publication process for certified datasets and report definitions.
Explanation
Correct Answer
B:Restrict report export and underlying dataset grants consistent with approved aggregate-only access. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A restricted user cannot download row-level records through any supported report action. Data sharing controls must cover export and connector capabilities as well as visible charts.
Incorrect Answers
A:Apply supported row access policies or governed authorized views with tenant controls. This addresses a different situation: A SaaS analytics platform hosts multiple tenant records in one BigQuery table, and users may see only their organization's rows. The current scenario instead calls for the more directly applicable engineering action: Restrict report export and underlying dataset grants consistent with approved aggregate-only access. The reason is that data sharing controls must cover export and connector capabilities as well as visible charts.
C:Publish a controlled BigQuery sharing listing and grant only approved subscriber access. This addresses a different situation: Two companies want to share selected curated BigQuery datasets without copying unrestricted source projects into each tenant. The current scenario instead calls for the more directly applicable engineering action: Restrict report export and underlying dataset grants consistent with approved aggregate-only access. The reason is that data sharing controls must cover export and connector capabilities as well as visible charts.
D:Create a controlled publication process for certified datasets and report definitions. This addresses a different situation: A finance department publishes unreviewed experiment tables to the company-wide BI directory and consumers treat them as financial statements. The current scenario instead calls for the more directly applicable engineering action: Restrict report export and underlying dataset grants consistent with approved aggregate-only access. The reason is that data sharing controls must cover export and connector capabilities as well as visible charts.
Question 339
The data engineering team must correct this issue: A team builds new SQL models in a development workspace but schedules them against production datasets using the same credentials. Which controlled engineering action is MOST appropriate?
- Implement a governed backfill workflow with bounded concurrent writes and reconciliation.
- Configure separate release workflows and narrowly scoped production invocation identities.
- Use a suitable Google Cloud Workflows definition for the small stateful service chain.
- Publish a tested parameterized template with approved environment configuration.
Explanation
Correct Answer
B:Configure separate release workflows and narrowly scoped production invocation identities. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: An experimental model cannot overwrite certified datasets without an approved promotion. ELT deployment should separate development compilation from production execution authority.
Incorrect Answers
A:Implement a governed backfill workflow with bounded concurrent writes and reconciliation. This addresses a different situation: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. The current scenario instead calls for the more directly applicable engineering action: Configure separate release workflows and narrowly scoped production invocation identities. The reason is that eLT deployment should separate development compilation from production execution authority.
C:Use a suitable Google Cloud Workflows definition for the small stateful service chain. This addresses a different situation: A lightweight pipeline calls several managed service APIs in order with retry rules, but the team proposes maintaining an entire Airflow deployment for one request chain. The current scenario instead calls for the more directly applicable engineering action: Configure separate release workflows and narrowly scoped production invocation identities. The reason is that eLT deployment should separate development compilation from production execution authority.
D:Publish a tested parameterized template with approved environment configuration. This addresses a different situation: The same Dataflow template should run in staging and production but contains hardcoded staging bucket names and service-account references. The current scenario instead calls for the more directly applicable engineering action: Configure separate release workflows and narrowly scoped production invocation identities. The reason is that eLT deployment should separate development compilation from production execution authority.
Question 340
A Google Cloud architecture review finds: A platform has steady high-volume SQL demand but is paying unpredictable per-query cost while finance requires capacity budgets. Which principle BEST explains the underlying data-engineering risk?
- Capacity pricing and reservations should be evaluated against measured utilization and service commitments.
- Query cost control starts with bytes processed, filters, and selecting only required columns.
- Job priority and capacity policies should reflect latency sensitivity and business importance.
- Flexible capacity and assignment strategies can isolate occasional bursts without starving core reporting.
Explanation
Correct Answer
A:Capacity pricing and reservations should be evaluated against measured utilization and service commitments. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Analyze historical slot use, edition features, on-demand costs, and commitment terms. A focused corrective action is: Model an appropriate BigQuery Editions capacity reservation with planned commitments.
Incorrect Answers
B:Query cost control starts with bytes processed, filters, and selecting only required columns. This addresses a different situation: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. The current scenario instead calls for the more directly applicable principle: Capacity pricing and reservations should be evaluated against measured utilization and service commitments. The reason is that capacity pricing and reservations should be evaluated against measured utilization and service commitments.
C:Job priority and capacity policies should reflect latency sensitivity and business importance. This addresses a different situation: A same-day executive dashboard competes with a large nonurgent nightly historical rebuild. The current scenario instead calls for the more directly applicable principle: Capacity pricing and reservations should be evaluated against measured utilization and service commitments. The reason is that capacity pricing and reservations should be evaluated against measured utilization and service commitments.
D:Flexible capacity and assignment strategies can isolate occasional bursts without starving core reporting. This addresses a different situation: A data science team needs occasional huge feature-engineering runs but competes with a permanently reserved reporting workload. The current scenario instead calls for the more directly applicable principle: Capacity pricing and reservations should be evaluated against measured utilization and service commitments. The reason is that capacity pricing and reservations should be evaluated against measured utilization and service commitments.