Google Professional Data Engineer Practice Test 59
Question 580
Before modifying the data platform, the team observes: Data teams use Cloud Storage for open formats and BigQuery for SQL, but each engine applies incompatible permissions to the same sensitive records. Which evidence should the engineer examine FIRST?
- Inspect access paths, row-key distribution, write bursts, and query predicate patterns.
- Review BigLake table grants, underlying bucket permissions, identities, and supported engines.
- Inspect domain contracts, catalog lineage, global policies, and consumer responsibilities.
- Review consumer SLAs, schema change history, alerting, and delivery timestamps.
Explanation
Correct Answer
B:Review BigLake table grants, underlying bucket permissions, identities, and supported engines. This evidence directly tests the uncertain part of the described system. Multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping. A controlled response is: Implement a governed lakehouse catalog and role model that avoids bypass through raw object access.
Incorrect Answers
A:Inspect access paths, row-key distribution, write bursts, and query predicate patterns. This addresses a different situation: A logistics app needs millisecond lookups for enormous numbers of sparse sensor rows keyed by device and time, with no requirement for SQL joins. The current scenario instead calls for the more directly applicable investigation: Review BigLake table grants, underlying bucket permissions, identities, and supported engines. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
C:Inspect domain contracts, catalog lineage, global policies, and consumer responsibilities. This addresses a different situation: Finance and logistics teams publish data independently, but a central team imposes one schema that ignores both domains' definitions. The current scenario instead calls for the more directly applicable investigation: Review BigLake table grants, underlying bucket permissions, identities, and supported engines. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
D:Review consumer SLAs, schema change history, alerting, and delivery timestamps. This addresses a different situation: An internal data product is advertised as reliable, but consumers receive schema changes and delayed data without notice. The current scenario instead calls for the more directly applicable investigation: Review BigLake table grants, underlying bucket permissions, identities, and supported engines. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
Question 581
A Google Cloud architecture review finds: A Dataflow JavaScript or Python user-defined transform catches every exception and returns an empty record, hiding thousands of failed rows. Which principle BEST explains the underlying data-engineering risk?
- Ingestion should use explicit schemas where data semantics cannot be inferred reliably.
- Throughput monitoring and correctly configured autoscaling help manage sustained stream backlogs.
- Retry-safe ELT needs deterministic merge keys and explicit source deduplication.
- Transformation failures require observable error paths and defined quality thresholds.
Explanation
Correct Answer
D:Transformation failures require observable error paths and defined quality thresholds. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Review UDF exceptions, input samples, metrics, and dead-letter records. A focused corrective action is: Add structured error outputs and fail or quarantine according to the data contract.
Incorrect Answers
A:Ingestion should use explicit schemas where data semantics cannot be inferred reliably. This addresses a different situation: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. The current scenario instead calls for the more directly applicable principle: Transformation failures require observable error paths and defined quality thresholds. The reason is that transformation failures require observable error paths and defined quality thresholds.
B:Throughput monitoring and correctly configured autoscaling help manage sustained stream backlogs. This addresses a different situation: During a marketing campaign, Pub/Sub backlog grows and Dataflow workers remain fixed far below incoming throughput. The current scenario instead calls for the more directly applicable principle: Transformation failures require observable error paths and defined quality thresholds. The reason is that transformation failures require observable error paths and defined quality thresholds.
C:Retry-safe ELT needs deterministic merge keys and explicit source deduplication. This addresses a different situation: A nightly BigQuery MERGE job occasionally reruns after an orchestrator timeout and inserts duplicate business keys. The current scenario instead calls for the more directly applicable principle: Transformation failures require observable error paths and defined quality thresholds. The reason is that transformation failures require observable error paths and defined quality thresholds.
Question 582
After applying the change, the team re-examines this condition: A small business runs a conventional PostgreSQL order service and needs managed backups and routine high availability without massive global horizontal write scale. Which result BEST verifies the improvement?
- The service completes transactional tests and a recovery rehearsal meets the business objective.
- Representative OLTP and read-heavy workloads meet measured latency and consistency targets.
- An attempted early deletion is denied while authorized read access remains available.
- A representative date-filtered query scans fewer bytes without changing results.
Explanation
Correct Answer
A:The service completes transactional tests and a recovery rehearsal meets the business objective. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Use a suitable Cloud SQL edition and HA configuration with controlled migrations. Cloud SQL is a managed relational option for compatible transactional application workloads.
Incorrect Answers
B:Representative OLTP and read-heavy workloads meet measured latency and consistency targets. This addresses a different situation: A PostgreSQL-compatible application has intensive operational transactions plus complex analytical queries and wants compatible managed performance options. The current scenario instead calls for the more directly applicable verification result: The service completes transactional tests and a recovery rehearsal meets the business objective. The reason is that cloud SQL is a managed relational option for compatible transactional application workloads.
C:An attempted early deletion is denied while authorized read access remains available. This addresses a different situation: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. The current scenario instead calls for the more directly applicable verification result: The service completes transactional tests and a recovery rehearsal meets the business objective. The reason is that cloud SQL is a managed relational option for compatible transactional application workloads.
D:A representative date-filtered query scans fewer bytes without changing results. This addresses a different situation: A warehouse stores years of events and most reports filter by event date and customer segment, but all queries scan the full table. The current scenario instead calls for the more directly applicable verification result: The service completes transactional tests and a recovery rehearsal meets the business objective. The reason is that cloud SQL is a managed relational option for compatible transactional application workloads.
Question 583
After applying the change, the team re-examines this condition: Three applications produce events into a common stream, and one deploys a breaking field rename without notifying downstream consumers. Which result BEST verifies the improvement?
- A representative scaled load meets freshness and query objectives without changing dashboard contracts.
- The same reviewed pipeline source deploys to a permitted second region with valid regional resources.
- A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics.
- A breaking event schema is rejected before downstream processors begin failing.
Explanation
Correct Answer
D:A breaking event schema is rejected before downstream processors begin failing. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Enforce registry or versioned schema compatibility checks before deploying producer changes. Shared data contracts need compatible evolution rules and consumer validation.
Incorrect Answers
A:A representative scaled load meets freshness and query objectives without changing dashboard contracts. This addresses a different situation: A pilot warehouse handles thousands of daily events but must support hundreds of millions without rewriting every consuming dashboard. The current scenario instead calls for the more directly applicable verification result: A breaking event schema is rejected before downstream processors begin failing. The reason is that shared data contracts need compatible evolution rules and consumer validation.
B:The same reviewed pipeline source deploys to a permitted second region with valid regional resources. This addresses a different situation: A pipeline deployment hardcodes one project ID and dataset location into every query, blocking deployment into another approved region. The current scenario instead calls for the more directly applicable verification result: A breaking event schema is rejected before downstream processors begin failing. The reason is that shared data contracts need compatible evolution rules and consumer validation.
C:A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics. This addresses a different situation: A company lands vendor extracts directly in curated datasets, making it impossible to distinguish unvalidated source values from approved metrics. The current scenario instead calls for the more directly applicable verification result: A breaking event schema is rejected before downstream processors begin failing. The reason is that shared data contracts need compatible evolution rules and consumer validation.
Question 584
After applying the change, the team re-examines this condition: Poison messages repeatedly fail subscriber parsing, preventing healthy telemetry events from moving through the subscription. Which result BEST verifies the improvement?
- A representative heavy-key workload scales without one worker dominating processing time.
- Malformed events are quarantined with traceable context while valid events continue.
- A producer event is available to the approved cloud consumer without changing producer behavior.
- A sample source change is ingested and transformed consistently without manual code edits.
Explanation
Correct Answer
B:Malformed events are quarantined with traceable context while valid events continue. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Configure an approved dead-letter topic and remediation workflow with appropriate retry policy. Invalid messages need bounded retry, quarantine, and replay decisions.
Incorrect Answers
A:A representative heavy-key workload scales without one worker dominating processing time. This addresses a different situation: A Dataflow group-by-key stage slows because almost all events share one constant grouping value. The current scenario instead calls for the more directly applicable verification result: Malformed events are quarantined with traceable context while valid events continue. The reason is that invalid messages need bounded retry, quarantine, and replay decisions.
C:A producer event is available to the approved cloud consumer without changing producer behavior. This addresses a different situation: A platform has existing Kafka producers and needs to introduce cloud analytics without rewriting every producer immediately. The current scenario instead calls for the more directly applicable verification result: Malformed events are quarantined with traceable context while valid events continue. The reason is that invalid messages need bounded retry, quarantine, and replay decisions.
D:A sample source change is ingested and transformed consistently without manual code edits. This addresses a different situation: A team has several supported relational sources and needs standard cleansing workflows but maintains dozens of brittle custom extraction scripts. The current scenario instead calls for the more directly applicable verification result: Malformed events are quarantined with traceable context while valid events continue. The reason is that invalid messages need bounded retry, quarantine, and replay decisions.
Question 585
The data engineering team must correct this issue: A pipeline deployment hardcodes one project ID and dataset location into every query, blocking deployment into another approved region. Which controlled engineering action is MOST appropriate?
- Register curated assets in an approved catalog with owners, business definitions, and lineage.
- Separate portable transformation logic from provider-specific orchestration and version the deployment configuration.
- Enforce registry or versioned schema compatibility checks before deploying producer changes.
- Parameterize destination projects and locations through controlled environment configuration.
Explanation
Correct Answer
D:Parameterize destination projects and locations through controlled environment configuration. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: The same reviewed pipeline source deploys to a permitted second region with valid regional resources. Deployment portability requires parameterized environment-specific resources and validated locations.
Incorrect Answers
A:Register curated assets in an approved catalog with owners, business definitions, and lineage. This addresses a different situation: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. The current scenario instead calls for the more directly applicable engineering action: Parameterize destination projects and locations through controlled environment configuration. The reason is that deployment portability requires parameterized environment-specific resources and validated locations.
B:Separate portable transformation logic from provider-specific orchestration and version the deployment configuration. This addresses a different situation: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. The current scenario instead calls for the more directly applicable engineering action: Parameterize destination projects and locations through controlled environment configuration. The reason is that deployment portability requires parameterized environment-specific resources and validated locations.
C:Enforce registry or versioned schema compatibility checks before deploying producer changes. This addresses a different situation: Three applications produce events into a common stream, and one deploys a breaking field rename without notifying downstream consumers. The current scenario instead calls for the more directly applicable engineering action: Parameterize destination projects and locations through controlled environment configuration. The reason is that deployment portability requires parameterized environment-specific resources and validated locations.
Question 586
A Google Cloud data engineer is addressing: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. Which TWO complementary actions should the team take? Select TWO answers.
- Review source data dictionary, sample values, load schema options, and rejected row records.
- Define product IDs as string fields and validate source formats before BigQuery loading.
- Inspect Spark UI shuffle metrics, skew, executor memory, and partition configuration.
- Tune Dataflow worker limits and pipeline stages using measured bottlenecks.
- Inspect Kafka topic retention, schema contracts, network access, and bridge/connector support.
Explanation
Correct Answers
A:Review source data dictionary, sample values, load schema options, and rejected row records. This is the applicable diagnostic investigation. Its complementary step is: Define product IDs as string fields and validate source formats before BigQuery loading. Together they address: Ingestion should use explicit schemas where data semantics cannot be inferred reliably.
B:Define product IDs as string fields and validate source formats before BigQuery loading. This is the applicable controlled engineering response. Its complementary step is: Review source data dictionary, sample values, load schema options, and rejected row records. Together they address: Ingestion should use explicit schemas where data semantics cannot be inferred reliably.
Incorrect Answers
C:Inspect Spark UI shuffle metrics, skew, executor memory, and partition configuration. This could be useful for another system: A Dataproc Spark batch shuffles terabytes into a handful of very large partitions and regularly runs out of memory. For this situation, the necessary paired decisions are to examine (Review source data dictionary, sample values, load schema options, and rejected row records.) and to implement (Define product IDs as string fields and validate source formats before BigQuery loading.).
D:Tune Dataflow worker limits and pipeline stages using measured bottlenecks. This could be useful for another system: During a marketing campaign, Pub/Sub backlog grows and Dataflow workers remain fixed far below incoming throughput. For this situation, the necessary paired decisions are to examine (Review source data dictionary, sample values, load schema options, and rejected row records.) and to implement (Define product IDs as string fields and validate source formats before BigQuery loading.).
E:Inspect Kafka topic retention, schema contracts, network access, and bridge/connector support. This could be useful for another system: A platform has existing Kafka producers and needs to introduce cloud analytics without rewriting every producer immediately. For this situation, the necessary paired decisions are to examine (Review source data dictionary, sample values, load schema options, and rejected row records.) and to implement (Define product IDs as string fields and validate source formats before BigQuery loading.).
Question 587
After applying the change, the team re-examines this condition: Daily vendor deliveries contain multipart files with duplicate names and changing schemas, making ingestion traceability unreliable. Which result BEST verifies the improvement?
- An authorized recovery replays events from a simulated outage without missing the required interval.
- Re-delivering a file yields a traceable duplicate decision without overwriting certified data.
- A replayed burst produces anomaly alerts within the specified detection window.
- A source extract reaches the authorized destination without exposing an unauthenticated public endpoint.
Explanation
Correct Answer
B:Re-delivering a file yields a traceable duplicate decision without overwriting certified data. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Adopt versioned landing paths and idempotent manifest processing before transformation. Immutable landing identity and manifest metadata enable replay and operational reconciliation.
Incorrect Answers
A:An authorized recovery replays events from a simulated outage without missing the required interval. This addresses a different situation: A vehicle telemetry stream might need replay after an outage, but source retention expires sooner than the required recovery window. The current scenario instead calls for the more directly applicable verification result: Re-delivering a file yields a traceable duplicate decision without overwriting certified data. The reason is that immutable landing identity and manifest metadata enable replay and operational reconciliation.
C:A replayed burst produces anomaly alerts within the specified detection window. This addresses a different situation: A payment service must detect suspicious transaction patterns within seconds rather than after overnight aggregation. The current scenario instead calls for the more directly applicable verification result: Re-delivering a file yields a traceable duplicate decision without overwriting certified data. The reason is that immutable landing identity and manifest metadata enable replay and operational reconciliation.
D:A source extract reaches the authorized destination without exposing an unauthenticated public endpoint. This addresses a different situation: An internal ERP system sends sensitive database extracts to Google Cloud but security rules prohibit unrestricted internet endpoints. The current scenario instead calls for the more directly applicable verification result: Re-delivering a file yields a traceable duplicate decision without overwriting certified data. The reason is that immutable landing identity and manifest metadata enable replay and operational reconciliation.
Question 588
After applying the change, the team re-examines this condition: A sales dashboard adds hourly clicks to daily orders with a join on date only, producing inflated conversion rates. Which result BEST verifies the improvement?
- The revised query scans the expected partitions with the same result set.
- A malicious test filter is treated as data rather than executing unintended SQL.
- A report viewer sees allowed campaign totals but cannot extract protected customer records.
- A sampled date reconciles clicks and orders without multiplication across hourly rows.
Explanation
Correct Answer
D:A sampled date reconciles clicks and orders without multiplication across hourly rows. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Aggregate source facts to a common approved grain before joining or visualizing. BI measures must be combined at compatible time and entity granularity.
Incorrect Answers
A:The revised query scans the expected partitions with the same result set. This addresses a different situation: An analyst filters a partitioned BigQuery table by wrapping the partition column in a complex function and sees a costly full scan. The current scenario instead calls for the more directly applicable verification result: A sampled date reconciles clicks and orders without multiplication across hourly rows. The reason is that bI measures must be combined at compatible time and entity granularity.
B:A malicious test filter is treated as data rather than executing unintended SQL. This addresses a different situation: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. The current scenario instead calls for the more directly applicable verification result: A sampled date reconciles clicks and orders without multiplication across hourly rows. The reason is that bI measures must be combined at compatible time and entity granularity.
C:A report viewer sees allowed campaign totals but cannot extract protected customer records. This addresses a different situation: A marketing dashboard in Looker Studio displays performance summaries but the configured data source grants unrestricted access to restricted BigQuery customer fields. The current scenario instead calls for the more directly applicable verification result: A sampled date reconciles clicks and orders without multiplication across hourly rows. The reason is that bI measures must be combined at compatible time and entity granularity.
Question 589
Before modifying the data platform, the team observes: An ecommerce service repeatedly looks up the same short-lived inventory recommendations and overwhelms its primary datastore during traffic peaks. Which evidence should the engineer examine FIRST?
- Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load.
- Inspect filter selectivity, partitions scanned, clustering cardinality, and query statistics.
- Analyze object age, access logs, retrieval expectations, storage classes, and retention requirements.
- Review legal retention periods, bucket settings, object holds, and administrator rights.
Explanation
Correct Answer
A:Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load. This evidence directly tests the uncertain part of the described system. A managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth. A controlled response is: Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks.
Incorrect Answers
B:Inspect filter selectivity, partitions scanned, clustering cardinality, and query statistics. This addresses a different situation: A warehouse stores years of events and most reports filter by event date and customer segment, but all queries scan the full table. The current scenario instead calls for the more directly applicable investigation: Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load. The reason is that a managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
C:Analyze object age, access logs, retrieval expectations, storage classes, and retention requirements. This addresses a different situation: A media company keeps infrequently accessed raw video assets in standard storage for years and has no retention or retrieval policy. The current scenario instead calls for the more directly applicable investigation: Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load. The reason is that a managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
D:Review legal retention periods, bucket settings, object holds, and administrator rights. This addresses a different situation: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. The current scenario instead calls for the more directly applicable investigation: Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load. The reason is that a managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
Question 590
A Google Cloud architecture review finds: Developers change Dataflow transform logic directly in production with no version tags or regression tests. Which principle BEST explains the underlying data-engineering risk?
- Data pipeline CI/CD should validate schema, code, and deployment before production promotion.
- Reusable deployment artifacts require versioned code plus environment-specific parameterization.
- Production scheduling should use maintained workload identities and explicit ownership.
- Backfill orchestration needs controlled concurrency and partition-level change coordination.
Explanation
Correct Answer
A:Data pipeline CI/CD should validate schema, code, and deployment before production promotion. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Review repository branches, build artifacts, test cases, and environment permissions. A focused corrective action is: Add a reviewed CI pipeline with unit/integration tests and controlled Dataflow template promotion.
Incorrect Answers
B:Reusable deployment artifacts require versioned code plus environment-specific parameterization. This addresses a different situation: The same Dataflow template should run in staging and production but contains hardcoded staging bucket names and service-account references. The current scenario instead calls for the more directly applicable principle: Data pipeline CI/CD should validate schema, code, and deployment before production promotion. The reason is that data pipeline CI/CD should validate schema, code, and deployment before production promotion.
C:Production scheduling should use maintained workload identities and explicit ownership. This addresses a different situation: A recurring transformation runs under the credentials of a departed analyst and begins failing when the account is disabled. The current scenario instead calls for the more directly applicable principle: Data pipeline CI/CD should validate schema, code, and deployment before production promotion. The reason is that data pipeline CI/CD should validate schema, code, and deployment before production promotion.
D:Backfill orchestration needs controlled concurrency and partition-level change coordination. This addresses a different situation: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. The current scenario instead calls for the more directly applicable principle: Data pipeline CI/CD should validate schema, code, and deployment before production promotion. The reason is that data pipeline CI/CD should validate schema, code, and deployment before production promotion.