Google Professional Data Engineer Practice Test 32
Question 310
A Google Cloud data engineer is addressing: A lake accumulates experimental intermediate outputs that cost more than final retained datasets and lacks automated expiration. Which TWO complementary actions should the team take? Select TWO answers.
- Compare source schemas, quality rules, ingestion logs, and rejected rows.
- Inventory object prefixes, formats, source owners, and data classification.
- Create a tagged lifecycle policy for transient processing artifacts with documented exclusions.
- Review bucket usage, object ages, lineage references, recovery requirements, and storage cost.
- Create segregated governed storage or lake access policies with least-privilege permissions.
Explanation
Correct Answers
C:Create a tagged lifecycle policy for transient processing artifacts with documented exclusions. This is the applicable controlled engineering response. Its complementary step is: Review bucket usage, object ages, lineage references, recovery requirements, and storage cost. Together they address: Intermediate-data retention should follow business utility, lineage, and compliance policy.
D:Review bucket usage, object ages, lineage references, recovery requirements, and storage cost. This is the applicable diagnostic investigation. Its complementary step is: Create a tagged lifecycle policy for transient processing artifacts with documented exclusions. Together they address: Intermediate-data retention should follow business utility, lineage, and compliance policy.
Incorrect Answers
A:Compare source schemas, quality rules, ingestion logs, and rejected rows. This could be useful for another system: Multiple departments publish raw JSON to a shared lake with inconsistent field definitions that break downstream reusable tables. For this situation, the necessary paired decisions are to examine (Review bucket usage, object ages, lineage references, recovery requirements, and storage cost.) and to implement (Create a tagged lifecycle policy for transient processing artifacts with documented exclusions.).
B:Inventory object prefixes, formats, source owners, and data classification. This could be useful for another system: Researchers place thousands of raw objects in a data lake and cannot identify schemas, ownership, or classification. For this situation, the necessary paired decisions are to examine (Review bucket usage, object ages, lineage references, recovery requirements, and storage cost.) and to implement (Create a tagged lifecycle policy for transient processing artifacts with documented exclusions.).
E:Create segregated governed storage or lake access policies with least-privilege permissions. This could be useful for another system: A research lake contains both public scientific data and restricted patient samples under one bucket with unrestricted reader roles. For this situation, the necessary paired decisions are to examine (Review bucket usage, object ages, lineage references, recovery requirements, and storage cost.) and to implement (Create a tagged lifecycle policy for transient processing artifacts with documented exclusions.).
Question 311
A Google Cloud data engineer is addressing: A Dataflow batch pipeline processes a few large files using hundreds of workers while bottlenecked on one serialized source stage. Which TWO complementary actions should the team take? Select TWO answers.
- Review reservation assignments, edition capacity, slot utilization, and job priorities.
- Right-size workers and improve the serial input bottleneck before increasing capacity.
- Review object access frequency, retention, retrieval cost, and lifecycle rules.
- Inspect per-stage parallelism, worker utilization, input sharding, and elapsed time.
- Inspect BigQuery job statistics, query projections, filters, and data partitions.
Explanation
Correct Answers
B:Right-size workers and improve the serial input bottleneck before increasing capacity. This is the applicable controlled engineering response. Its complementary step is: Inspect per-stage parallelism, worker utilization, input sharding, and elapsed time. Together they address: Worker cost optimization must follow actual pipeline parallelism and bottlenecks.
D:Inspect per-stage parallelism, worker utilization, input sharding, and elapsed time. This is the applicable diagnostic investigation. Its complementary step is: Right-size workers and improve the serial input bottleneck before increasing capacity. Together they address: Worker cost optimization must follow actual pipeline parallelism and bottlenecks.
Incorrect Answers
A:Review reservation assignments, edition capacity, slot utilization, and job priorities. This could be useful for another system: Critical dashboards compete with scheduled ETL jobs for BigQuery slots and miss interactive latency targets. For this situation, the necessary paired decisions are to examine (Inspect per-stage parallelism, worker utilization, input sharding, and elapsed time.) and to implement (Right-size workers and improve the serial input bottleneck before increasing capacity.).
C:Review object access frequency, retention, retrieval cost, and lifecycle rules. This could be useful for another system: A media archive changes every object to the coldest storage class even though analysts read recent objects daily. For this situation, the necessary paired decisions are to examine (Inspect per-stage parallelism, worker utilization, input sharding, and elapsed time.) and to implement (Right-size workers and improve the serial input bottleneck before increasing capacity.).
E:Inspect BigQuery job statistics, query projections, filters, and data partitions. This could be useful for another system: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. For this situation, the necessary paired decisions are to examine (Inspect per-stage parallelism, worker utilization, input sharding, and elapsed time.) and to implement (Right-size workers and improve the serial input bottleneck before increasing capacity.).
Question 312
A Google Cloud architecture review finds: The same Dataflow template should run in staging and production but contains hardcoded staging bucket names and service-account references. Which principle BEST explains the underlying data-engineering risk?
- Orchestration retries must respect the idempotency of downstream actions.
- Orchestration must gate downstream tasks on verified upstream readiness.
- Reusable deployment artifacts require versioned code plus environment-specific parameterization.
- Backfill orchestration needs controlled concurrency and partition-level change coordination.
Explanation
Correct Answer
C:Reusable deployment artifacts require versioned code plus environment-specific parameterization. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect template options, bucket identifiers, worker identities, and region restrictions. A focused corrective action is: Publish a tested parameterized template with approved environment configuration.
Incorrect Answers
A:Orchestration retries must respect the idempotency of downstream actions. This addresses a different situation: A pipeline triggers an invoice-export API and Airflow retries the task after a timeout, sending the same invoice twice. The current scenario instead calls for the more directly applicable principle: Reusable deployment artifacts require versioned code plus environment-specific parameterization. The reason is that reusable deployment artifacts require versioned code plus environment-specific parameterization.
B:Orchestration must gate downstream tasks on verified upstream readiness. This addresses a different situation: An Airflow DAG launches a billing aggregation before its source partition arrives, producing empty reports that appear successful. The current scenario instead calls for the more directly applicable principle: Reusable deployment artifacts require versioned code plus environment-specific parameterization. The reason is that reusable deployment artifacts require versioned code plus environment-specific parameterization.
D:Backfill orchestration needs controlled concurrency and partition-level change coordination. This addresses a different situation: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. The current scenario instead calls for the more directly applicable principle: Reusable deployment artifacts require versioned code plus environment-specific parameterization. The reason is that reusable deployment artifacts require versioned code plus environment-specific parameterization.
Question 313
A Google Cloud architecture review finds: Poison messages repeatedly fail subscriber parsing, preventing healthy telemetry events from moving through the subscription. Which principle BEST explains the underlying data-engineering risk?
- Managed integration tools can simplify source connectivity and repeatable mappings when requirements fit.
- Transformation failures require observable error paths and defined quality thresholds.
- Invalid messages need bounded retry, quarantine, and replay decisions.
- Streaming enrichment needs bounded waits or defined fallback handling for delayed side inputs.
Explanation
Correct Answer
C:Invalid messages need bounded retry, quarantine, and replay decisions. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect delivery attempt counts, error patterns, dead-letter configuration, and acknowledgements. A focused corrective action is: Configure an approved dead-letter topic and remediation workflow with appropriate retry policy.
Incorrect Answers
A:Managed integration tools can simplify source connectivity and repeatable mappings when requirements fit. This addresses a different situation: A team has several supported relational sources and needs standard cleansing workflows but maintains dozens of brittle custom extraction scripts. The current scenario instead calls for the more directly applicable principle: Invalid messages need bounded retry, quarantine, and replay decisions. The reason is that invalid messages need bounded retry, quarantine, and replay decisions.
B:Transformation failures require observable error paths and defined quality thresholds. This addresses a different situation: A Dataflow JavaScript or Python user-defined transform catches every exception and returns an empty record, hiding thousands of failed rows. The current scenario instead calls for the more directly applicable principle: Invalid messages need bounded retry, quarantine, and replay decisions. The reason is that invalid messages need bounded retry, quarantine, and replay decisions.
D:Streaming enrichment needs bounded waits or defined fallback handling for delayed side inputs. This addresses a different situation: Device readings arrive every second but the related factory equipment registration data changes hourly, producing joins with missing references. The current scenario instead calls for the more directly applicable principle: Invalid messages need bounded retry, quarantine, and replay decisions. The reason is that invalid messages need bounded retry, quarantine, and replay decisions.
Question 314
After applying the change, the team re-examines this condition: An embedded dashboard lets viewers export all underlying data even though contracts permit only monthly aggregates. Which result BEST verifies the improvement?
- A customer sees only allowed service metrics and cannot read base employee-level rows.
- Consumers can identify the approved financial dataset while draft tables remain clearly labeled.
- A restricted user cannot download row-level records through any supported report action.
- A tenant user cannot query another organization's records through ordinary analytics tools.
Explanation
Correct Answer
C:A restricted user cannot download row-level records through any supported report action. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Restrict report export and underlying dataset grants consistent with approved aggregate-only access. Data sharing controls must cover export and connector capabilities as well as visible charts.
Incorrect Answers
A:A customer sees only allowed service metrics and cannot read base employee-level rows. This addresses a different situation: A service provider exposes aggregate service quality metrics to customers but must not reveal individual employee work records. The current scenario instead calls for the more directly applicable verification result: A restricted user cannot download row-level records through any supported report action. The reason is that data sharing controls must cover export and connector capabilities as well as visible charts.
B:Consumers can identify the approved financial dataset while draft tables remain clearly labeled. This addresses a different situation: A finance department publishes unreviewed experiment tables to the company-wide BI directory and consumers treat them as financial statements. The current scenario instead calls for the more directly applicable verification result: A restricted user cannot download row-level records through any supported report action. The reason is that data sharing controls must cover export and connector capabilities as well as visible charts.
D:A tenant user cannot query another organization's records through ordinary analytics tools. This addresses a different situation: A SaaS analytics platform hosts multiple tenant records in one BigQuery table, and users may see only their organization's rows. The current scenario instead calls for the more directly applicable verification result: A restricted user cannot download row-level records through any supported report action. The reason is that data sharing controls must cover export and connector capabilities as well as visible charts.
Question 315
A Google Cloud data engineer is addressing: A production model receives categorical values in a format different from the BigQuery ML training transformations. Which TWO complementary actions should the team take? Select TWO answers.
- Inspect document types, OCR quality, extracted text, language detection, and document access.
- Inspect preprocessing definitions, feature encodings, input schemas, and deployed inference logic.
- Version reusable transformations and validate feature parity between training and serving.
- Create a governed embedding pipeline with versioned updates and access-aware retrieval.
- Evaluate the model using appropriate metrics and select a reviewed operating threshold.
Explanation
Correct Answers
B:Inspect preprocessing definitions, feature encodings, input schemas, and deployed inference logic. This is the applicable diagnostic investigation. Its complementary step is: Version reusable transformations and validate feature parity between training and serving. Together they address: Training-serving feature consistency is essential for reliable inference quality.
C:Version reusable transformations and validate feature parity between training and serving. This is the applicable controlled engineering response. Its complementary step is: Inspect preprocessing definitions, feature encodings, input schemas, and deployed inference logic. Together they address: Training-serving feature consistency is essential for reliable inference quality.
Incorrect Answers
A:Inspect document types, OCR quality, extracted text, language detection, and document access. This could be useful for another system: A records team ingests scanned PDFs for semantic search but indexes raw unreadable binary bytes as if they were meaningful text. For this situation, the necessary paired decisions are to examine (Inspect preprocessing definitions, feature encodings, input schemas, and deployed inference logic.) and to implement (Version reusable transformations and validate feature parity between training and serving.).
D:Create a governed embedding pipeline with versioned updates and access-aware retrieval. This could be useful for another system: A customer-service assistant needs grounded retrieval from updated knowledge articles, but the current index mixes old and current documents without lineage. For this situation, the necessary paired decisions are to examine (Inspect preprocessing definitions, feature encodings, input schemas, and deployed inference logic.) and to implement (Version reusable transformations and validate feature parity between training and serving.).
E:Evaluate the model using appropriate metrics and select a reviewed operating threshold. This could be useful for another system: A fraud model reports 99 percent accuracy on data where only one in a thousand transactions is fraudulent. For this situation, the necessary paired decisions are to examine (Inspect preprocessing definitions, feature encodings, input schemas, and deployed inference logic.) and to implement (Version reusable transformations and validate feature parity between training and serving.).
Question 316
Before modifying the data platform, the team observes: A data lake ingestion job repeatedly misses one daily source partition yet storage dashboards show only total object count. Which evidence should the engineer examine FIRST?
- Review transaction isolation needs, region placement, query patterns, and write contention.
- Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories.
- Inventory object prefixes, formats, source owners, and data classification.
- Review bucket usage, object ages, lineage references, recovery requirements, and storage cost.
Explanation
Correct Answer
B:Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. This evidence directly tests the uncertain part of the described system. Lake operational monitoring needs partition completeness and business-level freshness signals. A controlled response is: Implement per-source completeness checks with actionable missing-partition alerts.
Incorrect Answers
A:Review transaction isolation needs, region placement, query patterns, and write contention. This addresses a different situation: A global order platform needs strongly consistent relational transactions across geographic users and plans to scale beyond a single traditional database instance. The current scenario instead calls for the more directly applicable investigation: Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.
C:Inventory object prefixes, formats, source owners, and data classification. This addresses a different situation: Researchers place thousands of raw objects in a data lake and cannot identify schemas, ownership, or classification. The current scenario instead calls for the more directly applicable investigation: Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.
D:Review bucket usage, object ages, lineage references, recovery requirements, and storage cost. This addresses a different situation: A lake accumulates experimental intermediate outputs that cost more than final retained datasets and lacks automated expiration. The current scenario instead calls for the more directly applicable investigation: Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. The reason is that lake operational monitoring needs partition completeness and business-level freshness signals.
Question 317
After applying the change, the team re-examines this condition: Two companies want to share selected curated BigQuery datasets without copying unrestricted source projects into each tenant. Which result BEST verifies the improvement?
- A restricted user cannot download row-level records through any supported report action.
- The subscriber queries an authorized shared dataset but cannot read unrelated publisher tables.
- A tenant user cannot query another organization's records through ordinary analytics tools.
- Consumers can identify the approved financial dataset while draft tables remain clearly labeled.
Explanation
Correct Answer
B:The subscriber queries an authorized shared dataset but cannot read unrelated publisher tables. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Publish a controlled BigQuery sharing listing and grant only approved subscriber access. Governed BigQuery sharing can provide authorized access to publisher datasets through supported sharing models.
Incorrect Answers
A:A restricted user cannot download row-level records through any supported report action. This addresses a different situation: An embedded dashboard lets viewers export all underlying data even though contracts permit only monthly aggregates. The current scenario instead calls for the more directly applicable verification result: The subscriber queries an authorized shared dataset but cannot read unrelated publisher tables. The reason is that governed BigQuery sharing can provide authorized access to publisher datasets through supported sharing models.
C:A tenant user cannot query another organization's records through ordinary analytics tools. This addresses a different situation: A SaaS analytics platform hosts multiple tenant records in one BigQuery table, and users may see only their organization's rows. The current scenario instead calls for the more directly applicable verification result: The subscriber queries an authorized shared dataset but cannot read unrelated publisher tables. The reason is that governed BigQuery sharing can provide authorized access to publisher datasets through supported sharing models.
D:Consumers can identify the approved financial dataset while draft tables remain clearly labeled. This addresses a different situation: A finance department publishes unreviewed experiment tables to the company-wide BI directory and consumers treat them as financial statements. The current scenario instead calls for the more directly applicable verification result: The subscriber queries an authorized shared dataset but cannot read unrelated publisher tables. The reason is that governed BigQuery sharing can provide authorized access to publisher datasets through supported sharing models.
Question 318
The data engineering team must correct this issue: Multiple departments publish raw JSON to a shared lake with inconsistent field definitions that break downstream reusable tables. Which controlled engineering action is MOST appropriate?
- Implement per-source completeness checks with actionable missing-partition alerts.
- Add governed quality checks and curate validated table formats while retaining raw provenance.
- Create segregated governed storage or lake access policies with least-privilege permissions.
- Create a tagged lifecycle policy for transient processing artifacts with documented exclusions.
Explanation
Correct Answer
B:Add governed quality checks and curate validated table formats while retaining raw provenance. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: An incompatible JSON change is flagged and does not silently enter certified lake tables. Data lake ingestion benefits from schema contracts, validation, and curated layers.
Incorrect Answers
A:Implement per-source completeness checks with actionable missing-partition alerts. This addresses a different situation: A data lake ingestion job repeatedly misses one daily source partition yet storage dashboards show only total object count. The current scenario instead calls for the more directly applicable engineering action: Add governed quality checks and curate validated table formats while retaining raw provenance. The reason is that data lake ingestion benefits from schema contracts, validation, and curated layers.
C:Create segregated governed storage or lake access policies with least-privilege permissions. This addresses a different situation: A research lake contains both public scientific data and restricted patient samples under one bucket with unrestricted reader roles. The current scenario instead calls for the more directly applicable engineering action: Add governed quality checks and curate validated table formats while retaining raw provenance. The reason is that data lake ingestion benefits from schema contracts, validation, and curated layers.
D:Create a tagged lifecycle policy for transient processing artifacts with documented exclusions. This addresses a different situation: A lake accumulates experimental intermediate outputs that cost more than final retained datasets and lacks automated expiration. The current scenario instead calls for the more directly applicable engineering action: Add governed quality checks and curate validated table formats while retaining raw provenance. The reason is that data lake ingestion benefits from schema contracts, validation, and curated layers.
Question 319
A Google Cloud data engineer is addressing: A lakehouse platform keeps Parquet in Cloud Storage but wants managed governance across BigQuery and compatible external engines. Which TWO complementary actions should the team take? Select TWO answers.
- Apply the approved Cloud Storage retention or hold mechanism with formal change control.
- Use a suitable Cloud SQL edition and HA configuration with controlled migrations.
- Review object layout, table format, supported engines, and access-control model.
- Inspect access paths, row-key distribution, write bursts, and query predicate patterns.
- Create supported BigLake tables and verified catalog grants for authorized engines.
Explanation
Correct Answers
C:Review object layout, table format, supported engines, and access-control model. This is the applicable diagnostic investigation. Its complementary step is: Create supported BigLake tables and verified catalog grants for authorized engines. Together they address: BigLake can provide managed table access and governance for eligible lake data across processing systems.
E:Create supported BigLake tables and verified catalog grants for authorized engines. This is the applicable controlled engineering response. Its complementary step is: Review object layout, table format, supported engines, and access-control model. Together they address: BigLake can provide managed table access and governance for eligible lake data across processing systems.
Incorrect Answers
A:Apply the approved Cloud Storage retention or hold mechanism with formal change control. This could be useful for another system: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. For this situation, the necessary paired decisions are to examine (Review object layout, table format, supported engines, and access-control model.) and to implement (Create supported BigLake tables and verified catalog grants for authorized engines.).
B:Use a suitable Cloud SQL edition and HA configuration with controlled migrations. This could be useful for another system: A small business runs a conventional PostgreSQL order service and needs managed backups and routine high availability without massive global horizontal write scale. For this situation, the necessary paired decisions are to examine (Review object layout, table format, supported engines, and access-control model.) and to implement (Create supported BigLake tables and verified catalog grants for authorized engines.).
D:Inspect access paths, row-key distribution, write bursts, and query predicate patterns. This could be useful for another system: A logistics app needs millisecond lookups for enormous numbers of sparse sensor rows keyed by device and time, with no requirement for SQL joins. For this situation, the necessary paired decisions are to examine (Review object layout, table format, supported engines, and access-control model.) and to implement (Create supported BigLake tables and verified catalog grants for authorized engines.).
Question 320
The data engineering team must correct this issue: A batch Hadoop estate has custom Spark jobs and HDFS storage tightly coupled to aging servers. Which controlled engineering action is MOST appropriate?
- Create a verified backfill manifest and idempotent incremental import with distinct landing paths.
- Use a supported Database Migration Service path and a rehearsed switchover with reconciliation.
- Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies.
- Configure supported Datastream change capture with consistent backfill and lag monitoring.
Explanation
Correct Answer
C:Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A representative Spark job produces reconciled output and meets its batch deadline. Migration planning should separate compute portability, durable storage, and dependency compatibility.
Incorrect Answers
A:Create a verified backfill manifest and idempotent incremental import with distinct landing paths. This addresses a different situation: A partner shares daily updates while an organization copies older archives into a new Cloud Storage lake. The current scenario instead calls for the more directly applicable engineering action: Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies. The reason is that migration planning should separate compute portability, durable storage, and dependency compatibility.
B:Use a supported Database Migration Service path and a rehearsed switchover with reconciliation. This addresses a different situation: An enterprise migrates a high-write transactional database to Google Cloud and cannot afford a long source freeze during cutover. The current scenario instead calls for the more directly applicable engineering action: Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies. The reason is that migration planning should separate compute portability, durable storage, and dependency compatibility.
D:Configure supported Datastream change capture with consistent backfill and lag monitoring. This addresses a different situation: A retail database migration captures historical tables but fails to process updates made after the initial snapshot. The current scenario instead calls for the more directly applicable engineering action: Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies. The reason is that migration planning should separate compute portability, durable storage, and dependency compatibility.