Google Professional Data Engineer Practice Test 29
Question 280
After applying the change, the team re-examines this condition: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. Which result BEST verifies the improvement?
- A representative transform can run in a second approved environment with predictable adjustments.
- Users can identify the certified retention dataset and its upstream systems without guessing.
- A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics.
- A breaking event schema is rejected before downstream processors begin failing.
Explanation
Correct Answer
A:A representative transform can run in a second approved environment with predictable adjustments. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Separate portable transformation logic from provider-specific orchestration and version the deployment configuration. Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
Incorrect Answers
B:Users can identify the certified retention dataset and its upstream systems without guessing. This addresses a different situation: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. The current scenario instead calls for the more directly applicable verification result: A representative transform can run in a second approved environment with predictable adjustments. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
C:A malformed vendor record stays in the landing layer and cannot silently corrupt executive metrics. This addresses a different situation: A company lands vendor extracts directly in curated datasets, making it impossible to distinguish unvalidated source values from approved metrics. The current scenario instead calls for the more directly applicable verification result: A representative transform can run in a second approved environment with predictable adjustments. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
D:A breaking event schema is rejected before downstream processors begin failing. This addresses a different situation: Three applications produce events into a common stream, and one deploys a breaking field rename without notifying downstream consumers. The current scenario instead calls for the more directly applicable verification result: A representative transform can run in a second approved environment with predictable adjustments. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
Question 281
A design review evaluates this situation: A large Spark cluster remains at peak worker count during long idle stages because autoscaling is disabled. Which shortcut should the team MOST specifically avoid?
- Double worker count repeatedly when one input transform can run only once.
- Set every job's worker count to peak historical size regardless of processing stage.
- Assume scanning every raw column is free because SQL contains a WHERE clause.
- Choose archive storage for frequently retrieved operational files solely from storage price.
Explanation
Correct Answer
B:Set every job's worker count to peak historical size regardless of processing stage. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Apply a supported autoscaling policy or job-based execution with performance safeguards. Why: Elastic batch processing should match provisioned workers to actual parallel workload demand.
Incorrect Answers
A:Double worker count repeatedly when one input transform can run only once. This addresses a different situation: A Dataflow batch pipeline processes a few large files using hundreds of workers while bottlenecked on one serialized source stage. The current scenario instead calls for the more directly applicable unsafe shortcut: Set every job's worker count to peak historical size regardless of processing stage. The reason is that elastic batch processing should match provisioned workers to actual parallel workload demand.
C:Assume scanning every raw column is free because SQL contains a WHERE clause. This addresses a different situation: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. The current scenario instead calls for the more directly applicable unsafe shortcut: Set every job's worker count to peak historical size regardless of processing stage. The reason is that elastic batch processing should match provisioned workers to actual parallel workload demand.
D:Choose archive storage for frequently retrieved operational files solely from storage price. This addresses a different situation: A media archive changes every object to the coldest storage class even though analysts read recent objects daily. The current scenario instead calls for the more directly applicable unsafe shortcut: Set every job's worker count to peak historical size regardless of processing stage. The reason is that elastic batch processing should match provisioned workers to actual parallel workload demand.
Question 282
A Google Cloud architecture review finds: A monthly tax report is generated once per period, but architects propose a continuously running expensive streaming engine. Which principle BEST explains the underlying data-engineering risk?
- Low-latency operational analytics need a streaming path with bounded end-to-end delay.
- Decoupled messaging can buffer variable event rates and isolate independent consumers.
- Immutable landing identity and manifest metadata enable replay and operational reconciliation.
- Processing mode should reflect data freshness requirements and operating cost.
Explanation
Correct Answer
D:Processing mode should reflect data freshness requirements and operating cost. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Clarify report deadline, daily source volume, latency expectations, and batch windows. A focused corrective action is: Use a scheduled batch processing workflow with timely validated delivery for monthly reporting.
Incorrect Answers
A:Low-latency operational analytics need a streaming path with bounded end-to-end delay. This addresses a different situation: A payment service must detect suspicious transaction patterns within seconds rather than after overnight aggregation. The current scenario instead calls for the more directly applicable principle: Processing mode should reflect data freshness requirements and operating cost. The reason is that processing mode should reflect data freshness requirements and operating cost.
B:Decoupled messaging can buffer variable event rates and isolate independent consumers. This addresses a different situation: Thousands of store devices publish small events unpredictably, and downstream systems must process them independently without blocking publishers. The current scenario instead calls for the more directly applicable principle: Processing mode should reflect data freshness requirements and operating cost. The reason is that processing mode should reflect data freshness requirements and operating cost.
C:Immutable landing identity and manifest metadata enable replay and operational reconciliation. This addresses a different situation: Daily vendor deliveries contain multipart files with duplicate names and changing schemas, making ingestion traceability unreliable. The current scenario instead calls for the more directly applicable principle: Processing mode should reflect data freshness requirements and operating cost. The reason is that processing mode should reflect data freshness requirements and operating cost.
Question 283
A Google Cloud architecture review finds: A lightweight pipeline calls several managed service APIs in order with retry rules, but the team proposes maintaining an entire Airflow deployment for one request chain. Which principle BEST explains the underlying data-engineering risk?
- Orchestration must gate downstream tasks on verified upstream readiness.
- Orchestration services should be selected according to complexity, operational overhead, and supported integration.
- Data pipeline CI/CD should validate schema, code, and deployment before production promotion.
- Backfill orchestration needs controlled concurrency and partition-level change coordination.
Explanation
Correct Answer
B:Orchestration services should be selected according to complexity, operational overhead, and supported integration. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect steps, retry policy, scheduling needs, and required service APIs. A focused corrective action is: Use a suitable Google Cloud Workflows definition for the small stateful service chain.
Incorrect Answers
A:Orchestration must gate downstream tasks on verified upstream readiness. This addresses a different situation: An Airflow DAG launches a billing aggregation before its source partition arrives, producing empty reports that appear successful. The current scenario instead calls for the more directly applicable principle: Orchestration services should be selected according to complexity, operational overhead, and supported integration. The reason is that orchestration services should be selected according to complexity, operational overhead, and supported integration.
C:Data pipeline CI/CD should validate schema, code, and deployment before production promotion. This addresses a different situation: Developers change Dataflow transform logic directly in production with no version tags or regression tests. The current scenario instead calls for the more directly applicable principle: Orchestration services should be selected according to complexity, operational overhead, and supported integration. The reason is that orchestration services should be selected according to complexity, operational overhead, and supported integration.
D:Backfill orchestration needs controlled concurrency and partition-level change coordination. This addresses a different situation: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. The current scenario instead calls for the more directly applicable principle: Orchestration services should be selected according to complexity, operational overhead, and supported integration. The reason is that orchestration services should be selected according to complexity, operational overhead, and supported integration.
Question 284
A Google Cloud architecture review finds: Critical dashboards compete with scheduled ETL jobs for BigQuery slots and miss interactive latency targets. Which principle BEST explains the underlying data-engineering risk?
- Compute capacity management should reflect distinct workloads and measured slot demand.
- Query cost control starts with bytes processed, filters, and selecting only required columns.
- Storage-class economics include retrieval fees and minimum duration, not only price per stored GB.
- Elastic batch processing should match provisioned workers to actual parallel workload demand.
Explanation
Correct Answer
A:Compute capacity management should reflect distinct workloads and measured slot demand. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Review reservation assignments, edition capacity, slot utilization, and job priorities. A focused corrective action is: Choose an appropriate BigQuery Editions reservation arrangement and workload assignments.
Incorrect Answers
B:Query cost control starts with bytes processed, filters, and selecting only required columns. This addresses a different situation: A reporting application repeatedly runs SELECT star against a wide event table and billing spikes even though it needs five fields. The current scenario instead calls for the more directly applicable principle: Compute capacity management should reflect distinct workloads and measured slot demand. The reason is that compute capacity management should reflect distinct workloads and measured slot demand.
C:Storage-class economics include retrieval fees and minimum duration, not only price per stored GB. This addresses a different situation: A media archive changes every object to the coldest storage class even though analysts read recent objects daily. The current scenario instead calls for the more directly applicable principle: Compute capacity management should reflect distinct workloads and measured slot demand. The reason is that compute capacity management should reflect distinct workloads and measured slot demand.
D:Elastic batch processing should match provisioned workers to actual parallel workload demand. This addresses a different situation: A large Spark cluster remains at peak worker count during long idle stages because autoscaling is disabled. The current scenario instead calls for the more directly applicable principle: Compute capacity management should reflect distinct workloads and measured slot demand. The reason is that compute capacity management should reflect distinct workloads and measured slot demand.
Question 285
A Google Cloud data engineer is addressing: A nightly BigQuery MERGE job occasionally reruns after an orchestrator timeout and inserts duplicate business keys. Which TWO complementary actions should the team take? Select TWO answers.
- Inspect primary business identifiers, source duplicates, merge conditions, and retry logs.
- Inspect ticket contents, model input logs, privacy policies, and enrichment accuracy.
- Add structured error outputs and fail or quarantine according to the data contract.
- Review source data dictionary, sample values, load schema options, and rejected row records.
- Use a validated staging table and deterministic BigQuery MERGE logic with deduplicated keys.
Explanation
Correct Answers
A:Inspect primary business identifiers, source duplicates, merge conditions, and retry logs. This is the applicable diagnostic investigation. Its complementary step is: Use a validated staging table and deterministic BigQuery MERGE logic with deduplicated keys. Together they address: Retry-safe ELT needs deterministic merge keys and explicit source deduplication.
E:Use a validated staging table and deterministic BigQuery MERGE logic with deduplicated keys. This is the applicable controlled engineering response. Its complementary step is: Inspect primary business identifiers, source duplicates, merge conditions, and retry logs. Together they address: Retry-safe ELT needs deterministic merge keys and explicit source deduplication.
Incorrect Answers
B:Inspect ticket contents, model input logs, privacy policies, and enrichment accuracy. This could be useful for another system: A content pipeline sends customer free-text support tickets to a generative model for categorization without excluding sensitive identifiers. For this situation, the necessary paired decisions are to examine (Inspect primary business identifiers, source duplicates, merge conditions, and retry logs.) and to implement (Use a validated staging table and deterministic BigQuery MERGE logic with deduplicated keys.).
C:Add structured error outputs and fail or quarantine according to the data contract. This could be useful for another system: A Dataflow JavaScript or Python user-defined transform catches every exception and returns an empty record, hiding thousands of failed rows. For this situation, the necessary paired decisions are to examine (Inspect primary business identifiers, source duplicates, merge conditions, and retry logs.) and to implement (Use a validated staging table and deterministic BigQuery MERGE logic with deduplicated keys.).
D:Review source data dictionary, sample values, load schema options, and rejected row records. This could be useful for another system: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. For this situation, the necessary paired decisions are to examine (Inspect primary business identifiers, source duplicates, merge conditions, and retry logs.) and to implement (Use a validated staging table and deterministic BigQuery MERGE logic with deduplicated keys.).
Question 286
The data engineering team must correct this issue: A global order platform needs strongly consistent relational transactions across geographic users and plans to scale beyond a single traditional database instance. Which controlled engineering action is MOST appropriate?
- Design a Spanner schema with appropriate primary keys and multi-region placement where justified.
- Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks.
- Benchmark a compatible AlloyDB deployment with appropriate read pools and operational design.
- Apply the approved Cloud Storage retention or hold mechanism with formal change control.
Explanation
Correct Answer
A:Design a Spanner schema with appropriate primary keys and multi-region placement where justified. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A cross-region transactional test preserves correctness under expected write and failover patterns. Spanner supports distributed relational transactions with strong consistency, subject to schema and locality design.
Incorrect Answers
B:Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks. This addresses a different situation: An ecommerce service repeatedly looks up the same short-lived inventory recommendations and overwhelms its primary datastore during traffic peaks. The current scenario instead calls for the more directly applicable engineering action: Design a Spanner schema with appropriate primary keys and multi-region placement where justified. The reason is that spanner supports distributed relational transactions with strong consistency, subject to schema and locality design.
C:Benchmark a compatible AlloyDB deployment with appropriate read pools and operational design. This addresses a different situation: A PostgreSQL-compatible application has intensive operational transactions plus complex analytical queries and wants compatible managed performance options. The current scenario instead calls for the more directly applicable engineering action: Design a Spanner schema with appropriate primary keys and multi-region placement where justified. The reason is that spanner supports distributed relational transactions with strong consistency, subject to schema and locality design.
D:Apply the approved Cloud Storage retention or hold mechanism with formal change control. This addresses a different situation: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. The current scenario instead calls for the more directly applicable engineering action: Design a Spanner schema with appropriate primary keys and multi-region placement where justified. The reason is that spanner supports distributed relational transactions with strong consistency, subject to schema and locality design.
Question 287
After applying the change, the team re-examines this condition: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. Which result BEST verifies the improvement?
- The revised query scans the expected partitions with the same result set.
- A malicious test filter is treated as data rather than executing unintended SQL.
- A sampled date reconciles clicks and orders without multiplication across hourly rows.
- A query reconciles with the underlying table within the documented refresh behavior.
Explanation
Correct Answer
B:A malicious test filter is treated as data rather than executing unintended SQL. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Use validated query parameters with reviewed field allowlists and read-only credentials. BI integrations should use parameterized queries and scoped read-only service identities.
Incorrect Answers
A:The revised query scans the expected partitions with the same result set. This addresses a different situation: An analyst filters a partitioned BigQuery table by wrapping the partition column in a complex function and sees a costly full scan. The current scenario instead calls for the more directly applicable verification result: A malicious test filter is treated as data rather than executing unintended SQL. The reason is that bI integrations should use parameterized queries and scoped read-only service identities.
C:A sampled date reconciles clicks and orders without multiplication across hourly rows. This addresses a different situation: A sales dashboard adds hourly clicks to daily orders with a join on date only, producing inflated conversion rates. The current scenario instead calls for the more directly applicable verification result: A malicious test filter is treated as data rather than executing unintended SQL. The reason is that bI integrations should use parameterized queries and scoped read-only service identities.
D:A query reconciles with the underlying table within the documented refresh behavior. This addresses a different situation: A reporting team creates a materialized view but expects it to instantaneously reflect every base-table update under all query patterns. The current scenario instead calls for the more directly applicable verification result: A malicious test filter is treated as data rather than executing unintended SQL. The reason is that bI integrations should use parameterized queries and scoped read-only service identities.
Question 288
A Google Cloud architecture review finds: A warehouse stores years of events and most reports filter by event date and customer segment, but all queries scan the full table. Which principle BEST explains the underlying data-engineering risk?
- Partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates.
- Object storage class and lifecycle choices should reflect access frequency, retrieval cost, and legal retention.
- Retention and hold controls can protect governed objects against premature removal.
- A managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
Explanation
Correct Answer
A:Partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect filter selectivity, partitions scanned, clustering cardinality, and query statistics. A focused corrective action is: Partition by the relevant date field and cluster on useful high-selectivity columns where appropriate.
Incorrect Answers
B:Object storage class and lifecycle choices should reflect access frequency, retrieval cost, and legal retention. This addresses a different situation: A media company keeps infrequently accessed raw video assets in standard storage for years and has no retention or retrieval policy. The current scenario instead calls for the more directly applicable principle: Partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates. The reason is that partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates.
C:Retention and hold controls can protect governed objects against premature removal. This addresses a different situation: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. The current scenario instead calls for the more directly applicable principle: Partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates. The reason is that partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates.
D:A managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth. This addresses a different situation: An ecommerce service repeatedly looks up the same short-lived inventory recommendations and overwhelms its primary datastore during traffic peaks. The current scenario instead calls for the more directly applicable principle: Partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates. The reason is that partitioning and clustering can reduce eligible BigQuery query scanning when aligned with predicates.
Question 289
After applying the change, the team re-examines this condition: A SaaS analytics platform hosts multiple tenant records in one BigQuery table, and users may see only their organization's rows. Which result BEST verifies the improvement?
- A tenant user cannot query another organization's records through ordinary analytics tools.
- The subscriber queries an authorized shared dataset but cannot read unrelated publisher tables.
- The retired partner cannot query the feed while other approved subscribers remain unaffected.
- Consumers can identify the approved financial dataset while draft tables remain clearly labeled.
Explanation
Correct Answer
A:A tenant user cannot query another organization's records through ordinary analytics tools. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Apply supported row access policies or governed authorized views with tenant controls. Row-level security can enforce tenant-scoped access when identity and policy design are correct.
Incorrect Answers
B:The subscriber queries an authorized shared dataset but cannot read unrelated publisher tables. This addresses a different situation: Two companies want to share selected curated BigQuery datasets without copying unrestricted source projects into each tenant. The current scenario instead calls for the more directly applicable verification result: A tenant user cannot query another organization's records through ordinary analytics tools. The reason is that row-level security can enforce tenant-scoped access when identity and policy design are correct.
C:The retired partner cannot query the feed while other approved subscribers remain unaffected. This addresses a different situation: A business data provider wants to revoke a partner's access to an outdated analytics feed without invalidating access for other subscribers. The current scenario instead calls for the more directly applicable verification result: A tenant user cannot query another organization's records through ordinary analytics tools. The reason is that row-level security can enforce tenant-scoped access when identity and policy design are correct.
D:Consumers can identify the approved financial dataset while draft tables remain clearly labeled. This addresses a different situation: A finance department publishes unreviewed experiment tables to the company-wide BI directory and consumers treat them as financial statements. The current scenario instead calls for the more directly applicable verification result: A tenant user cannot query another organization's records through ordinary analytics tools. The reason is that row-level security can enforce tenant-scoped access when identity and policy design are correct.
Question 290
A Google Cloud data engineer is addressing: An analytics team uses LLM-generated BigQuery SQL and executes it immediately against production tables with write privileges. Which TWO complementary actions should the team take? Select TWO answers.
- Review transaction boundaries, read-write patterns, recovery guarantees, and candidate database capabilities.
- Implement version-aware merges with authoritative ordering and an auditable correction pathway.
- Inspect proposed SQL statements, query plans, target datasets, write permissions, and test results.
- Require human-reviewed read-only dry runs and approved execution boundaries for generated queries.
- Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window.
Explanation
Correct Answers
C:Inspect proposed SQL statements, query plans, target datasets, write permissions, and test results. This is the applicable diagnostic investigation. Its complementary step is: Require human-reviewed read-only dry runs and approved execution boundaries for generated queries. Together they address: Generated SQL needs explicit validation, permission boundaries, and review before modifying governed data.
D:Require human-reviewed read-only dry runs and approved execution boundaries for generated queries. This is the applicable controlled engineering response. Its complementary step is: Inspect proposed SQL statements, query plans, target datasets, write permissions, and test results. Together they address: Generated SQL needs explicit validation, permission boundaries, and review before modifying governed data.
Incorrect Answers
A:Review transaction boundaries, read-write patterns, recovery guarantees, and candidate database capabilities. This could be useful for another system: An order service needs multi-row transactional correctness, yet engineers propose independent uncoordinated object writes as the system of record. For this situation, the necessary paired decisions are to examine (Inspect proposed SQL statements, query plans, target datasets, write permissions, and test results.) and to implement (Require human-reviewed read-only dry runs and approved execution boundaries for generated queries.).
B:Implement version-aware merges with authoritative ordering and an auditable correction pathway. This could be useful for another system: A reporting table is updated from multiple partners, and records arriving days late overwrite newer authoritative versions. For this situation, the necessary paired decisions are to examine (Inspect proposed SQL statements, query plans, target datasets, write permissions, and test results.) and to implement (Require human-reviewed read-only dry runs and approved execution boundaries for generated queries.).
E:Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window. This could be useful for another system: A payments stream retries messages after transient failures, causing duplicate warehouse revenue rows during replay. For this situation, the necessary paired decisions are to examine (Inspect proposed SQL statements, query plans, target datasets, write permissions, and test results.) and to implement (Require human-reviewed read-only dry runs and approved execution boundaries for generated queries.).