Google Professional Data Engineer Practice Test 18
Question 170
The data engineering team must correct this issue: A vehicle telemetry stream might need replay after an outage, but source retention expires sooner than the required recovery window. Which controlled engineering action is MOST appropriate?
- Use Pub/Sub and an appropriately configured Dataflow stream with an approved low-latency sink.
- Assign a stable entity key and configure supported ordered delivery or downstream sequence reconciliation.
- Adopt versioned landing paths and idempotent manifest processing before transformation.
- Configure appropriate message retention or raw event archival for replay and recovery.
Explanation
Correct Answer
D:Configure appropriate message retention or raw event archival for replay and recovery. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: An authorized recovery replays events from a simulated outage without missing the required interval. Replay and recovery objectives depend on source retention and durable staging choices.
Incorrect Answers
A:Use Pub/Sub and an appropriately configured Dataflow stream with an approved low-latency sink. This addresses a different situation: A payment service must detect suspicious transaction patterns within seconds rather than after overnight aggregation. The current scenario instead calls for the more directly applicable engineering action: Configure appropriate message retention or raw event archival for replay and recovery. The reason is that replay and recovery objectives depend on source retention and durable staging choices.
B:Assign a stable entity key and configure supported ordered delivery or downstream sequence reconciliation. This addresses a different situation: A product team requires per-customer event ordering but distributes all messages without a stable key and assumes total ordering across workers. The current scenario instead calls for the more directly applicable engineering action: Configure appropriate message retention or raw event archival for replay and recovery. The reason is that replay and recovery objectives depend on source retention and durable staging choices.
C:Adopt versioned landing paths and idempotent manifest processing before transformation. This addresses a different situation: Daily vendor deliveries contain multipart files with duplicate names and changing schemas, making ingestion traceability unreliable. The current scenario instead calls for the more directly applicable engineering action: Configure appropriate message retention or raw event archival for replay and recovery. The reason is that replay and recovery objectives depend on source retention and durable staging choices.
Question 171
Before modifying the data platform, the team observes: An internal data product is advertised as reliable, but consumers receive schema changes and delayed data without notice. Which evidence should the engineer examine FIRST?
- Review BigLake table grants, underlying bucket permissions, identities, and supported engines.
- Inventory asset metadata, domain tags, data types, and supported policy interfaces.
- Review consumer SLAs, schema change history, alerting, and delivery timestamps.
- Inspect domain contracts, catalog lineage, global policies, and consumer responsibilities.
Explanation
Correct Answer
C:Review consumer SLAs, schema change history, alerting, and delivery timestamps. This evidence directly tests the uncertain part of the described system. Published data products need explicit contracts for schemas, freshness, quality, and lifecycle. A controlled response is: Publish a versioned data contract with quality monitoring and consumer notification.
Incorrect Answers
A:Review BigLake table grants, underlying bucket permissions, identities, and supported engines. This addresses a different situation: Data teams use Cloud Storage for open formats and BigQuery for SQL, but each engine applies incompatible permissions to the same sensitive records. The current scenario instead calls for the more directly applicable investigation: Review consumer SLAs, schema change history, alerting, and delivery timestamps. The reason is that published data products need explicit contracts for schemas, freshness, quality, and lifecycle.
B:Inventory asset metadata, domain tags, data types, and supported policy interfaces. This addresses a different situation: A company acquires another business and wants consistent discovery and access classification across existing BigQuery and Cloud Storage assets. The current scenario instead calls for the more directly applicable investigation: Review consumer SLAs, schema change history, alerting, and delivery timestamps. The reason is that published data products need explicit contracts for schemas, freshness, quality, and lifecycle.
D:Inspect domain contracts, catalog lineage, global policies, and consumer responsibilities. This addresses a different situation: Finance and logistics teams publish data independently, but a central team imposes one schema that ignores both domains' definitions. The current scenario instead calls for the more directly applicable investigation: Review consumer SLAs, schema change history, alerting, and delivery timestamps. The reason is that published data products need explicit contracts for schemas, freshness, quality, and lifecycle.
Question 172
The data engineering team must correct this issue: A pilot warehouse handles thousands of daily events but must support hundreds of millions without rewriting every consuming dashboard. Which controlled engineering action is MOST appropriate?
- Design elastic ingestion and partitioned analytical storage with stable governed interfaces.
- Separate portable transformation logic from provider-specific orchestration and version the deployment configuration.
- Define governed staging and curated data layers with controlled promotion checks.
- Register curated assets in an approved catalog with owners, business definitions, and lineage.
Explanation
Correct Answer
A:Design elastic ingestion and partitioned analytical storage with stable governed interfaces. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A representative scaled load meets freshness and query objectives without changing dashboard contracts. Future scale requirements must influence partitioning, decoupling, and managed resource choices.
Incorrect Answers
B:Separate portable transformation logic from provider-specific orchestration and version the deployment configuration. This addresses a different situation: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. The current scenario instead calls for the more directly applicable engineering action: Design elastic ingestion and partitioned analytical storage with stable governed interfaces. The reason is that future scale requirements must influence partitioning, decoupling, and managed resource choices.
C:Define governed staging and curated data layers with controlled promotion checks. This addresses a different situation: A company lands vendor extracts directly in curated datasets, making it impossible to distinguish unvalidated source values from approved metrics. The current scenario instead calls for the more directly applicable engineering action: Design elastic ingestion and partitioned analytical storage with stable governed interfaces. The reason is that future scale requirements must influence partitioning, decoupling, and managed resource choices.
D:Register curated assets in an approved catalog with owners, business definitions, and lineage. This addresses a different situation: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. The current scenario instead calls for the more directly applicable engineering action: Design elastic ingestion and partitioned analytical storage with stable governed interfaces. The reason is that future scale requirements must influence partitioning, decoupling, and managed resource choices.
Question 173
A Google Cloud architecture review finds: An analyst filters a partitioned BigQuery table by wrapping the partition column in a complex function and sees a costly full scan. Which principle BEST explains the underlying data-engineering risk?
- Partition pruning depends on eligible predicates that the query planner can use.
- BI access must be governed at the data source and warehouse layer, not inferred from dashboard appearance.
- Materialized views have supported eligibility and freshness behavior that must be understood.
- Appropriate BI acceleration and precomputation can reduce latency when workloads and limits fit.
Explanation
Correct Answer
A:Partition pruning depends on eligible predicates that the query planner can use. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect query plan, partition filter expressions, bytes processed, and table partitioning. A focused corrective action is: Rewrite the filter to use an eligible direct partition range predicate where possible.
Incorrect Answers
B:BI access must be governed at the data source and warehouse layer, not inferred from dashboard appearance. This addresses a different situation: A marketing dashboard in Looker Studio displays performance summaries but the configured data source grants unrestricted access to restricted BigQuery customer fields. The current scenario instead calls for the more directly applicable principle: Partition pruning depends on eligible predicates that the query planner can use. The reason is that partition pruning depends on eligible predicates that the query planner can use.
C:Materialized views have supported eligibility and freshness behavior that must be understood. This addresses a different situation: A reporting team creates a materialized view but expects it to instantaneously reflect every base-table update under all query patterns. The current scenario instead calls for the more directly applicable principle: Partition pruning depends on eligible predicates that the query planner can use. The reason is that partition pruning depends on eligible predicates that the query planner can use.
D:Appropriate BI acceleration and precomputation can reduce latency when workloads and limits fit. This addresses a different situation: A high-traffic operational dashboard executes recurring BigQuery aggregations and users complain about slow interactive response. The current scenario instead calls for the more directly applicable principle: Partition pruning depends on eligible predicates that the query planner can use. The reason is that partition pruning depends on eligible predicates that the query planner can use.
Question 174
The data engineering team must correct this issue: Data teams use Cloud Storage for open formats and BigQuery for SQL, but each engine applies incompatible permissions to the same sensitive records. Which controlled engineering action is MOST appropriate?
- Establish federated roles and a platform operating model with common policies and domain exceptions.
- Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails.
- Implement a governed lakehouse catalog and role model that avoids bypass through raw object access.
- Create an approved Dataplex Catalog classification approach and map existing assets into it.
Explanation
Correct Answer
C:Implement a governed lakehouse catalog and role model that avoids bypass through raw object access. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A restricted identity is denied the same sensitive records through both SQL and direct object paths. Multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
Incorrect Answers
A:Establish federated roles and a platform operating model with common policies and domain exceptions. This addresses a different situation: A global enterprise distributes data ownership to regional teams but needs one standard for naming, retention, and access requests. The current scenario instead calls for the more directly applicable engineering action: Implement a governed lakehouse catalog and role model that avoids bypass through raw object access. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
B:Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. This addresses a different situation: Finance and logistics teams publish data independently, but a central team imposes one schema that ignores both domains' definitions. The current scenario instead calls for the more directly applicable engineering action: Implement a governed lakehouse catalog and role model that avoids bypass through raw object access. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
D:Create an approved Dataplex Catalog classification approach and map existing assets into it. This addresses a different situation: A company acquires another business and wants consistent discovery and access classification across existing BigQuery and Cloud Storage assets. The current scenario instead calls for the more directly applicable engineering action: Implement a governed lakehouse catalog and role model that avoids bypass through raw object access. The reason is that multi-engine data platforms need consistent access enforcement and auditable object-to-table mapping.
Question 175
Before modifying the data platform, the team observes: A lakehouse platform keeps Parquet in Cloud Storage but wants managed governance across BigQuery and compatible external engines. Which evidence should the engineer examine FIRST?
- Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load.
- Inspect access paths, row-key distribution, write bursts, and query predicate patterns.
- Review object layout, table format, supported engines, and access-control model.
- Profile read/write characteristics, PostgreSQL extensions, query plans, and service constraints.
Explanation
Correct Answer
C:Review object layout, table format, supported engines, and access-control model. This evidence directly tests the uncertain part of the described system. BigLake can provide managed table access and governance for eligible lake data across processing systems. A controlled response is: Create supported BigLake tables and verified catalog grants for authorized engines.
Incorrect Answers
A:Measure cache hit rates, staleness tolerance, eviction behavior, and underlying database load. This addresses a different situation: An ecommerce service repeatedly looks up the same short-lived inventory recommendations and overwhelms its primary datastore during traffic peaks. The current scenario instead calls for the more directly applicable investigation: Review object layout, table format, supported engines, and access-control model. The reason is that bigLake can provide managed table access and governance for eligible lake data across processing systems.
B:Inspect access paths, row-key distribution, write bursts, and query predicate patterns. This addresses a different situation: A logistics app needs millisecond lookups for enormous numbers of sparse sensor rows keyed by device and time, with no requirement for SQL joins. The current scenario instead calls for the more directly applicable investigation: Review object layout, table format, supported engines, and access-control model. The reason is that bigLake can provide managed table access and governance for eligible lake data across processing systems.
D:Profile read/write characteristics, PostgreSQL extensions, query plans, and service constraints. This addresses a different situation: A PostgreSQL-compatible application has intensive operational transactions plus complex analytical queries and wants compatible managed performance options. The current scenario instead calls for the more directly applicable investigation: Review object layout, table format, supported engines, and access-control model. The reason is that bigLake can provide managed table access and governance for eligible lake data across processing systems.
Question 176
The data engineering team must correct this issue: A global enterprise distributes data ownership to regional teams but needs one standard for naming, retention, and access requests. Which controlled engineering action is MOST appropriate?
- Establish federated roles and a platform operating model with common policies and domain exceptions.
- Implement a governed lakehouse catalog and role model that avoids bypass through raw object access.
- Publish a versioned data contract with quality monitoring and consumer notification.
- Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails.
Explanation
Correct Answer
A:Establish federated roles and a platform operating model with common policies and domain exceptions. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A cross-region access request follows an auditable owner approval without conflicting policies. Federated governance needs clear decision rights, shared policies, and local stewardship.
Incorrect Answers
B:Implement a governed lakehouse catalog and role model that avoids bypass through raw object access. This addresses a different situation: Data teams use Cloud Storage for open formats and BigQuery for SQL, but each engine applies incompatible permissions to the same sensitive records. The current scenario instead calls for the more directly applicable engineering action: Establish federated roles and a platform operating model with common policies and domain exceptions. The reason is that federated governance needs clear decision rights, shared policies, and local stewardship.
C:Publish a versioned data contract with quality monitoring and consumer notification. This addresses a different situation: An internal data product is advertised as reliable, but consumers receive schema changes and delayed data without notice. The current scenario instead calls for the more directly applicable engineering action: Establish federated roles and a platform operating model with common policies and domain exceptions. The reason is that federated governance needs clear decision rights, shared policies, and local stewardship.
D:Define domain-owned data products with cross-domain contracts, catalog registration, and shared guardrails. This addresses a different situation: Finance and logistics teams publish data independently, but a central team imposes one schema that ignores both domains' definitions. The current scenario instead calls for the more directly applicable engineering action: Establish federated roles and a platform operating model with common policies and domain exceptions. The reason is that federated governance needs clear decision rights, shared policies, and local stewardship.
Question 177
A Google Cloud architecture review finds: A reporting team creates a materialized view but expects it to instantaneously reflect every base-table update under all query patterns. Which principle BEST explains the underlying data-engineering risk?
- Central semantic definitions can prevent inconsistent business metrics across dashboards.
- Materialized views have supported eligibility and freshness behavior that must be understood.
- Dynamic masking and column access policies can limit sensitive detail without removing analytical utility.
- BI integrations should use parameterized queries and scoped read-only service identities.
Explanation
Correct Answer
B:Materialized views have supported eligibility and freshness behavior that must be understood. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect view definition, refresh status, source mutation rates, and query execution plans. A focused corrective action is: Design an eligible materialized aggregation and define an acceptable freshness contract.
Incorrect Answers
A:Central semantic definitions can prevent inconsistent business metrics across dashboards. This addresses a different situation: Two finance dashboards report different net revenue because they define discount treatment separately in handwritten SQL. The current scenario instead calls for the more directly applicable principle: Materialized views have supported eligibility and freshness behavior that must be understood. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
C:Dynamic masking and column access policies can limit sensitive detail without removing analytical utility. This addresses a different situation: Analysts need aggregate insurance-risk reporting while only authorized reviewers may see exact claimant identifiers. The current scenario instead calls for the more directly applicable principle: Materialized views have supported eligibility and freshness behavior that must be understood. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
D:BI integrations should use parameterized queries and scoped read-only service identities. This addresses a different situation: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. The current scenario instead calls for the more directly applicable principle: Materialized views have supported eligibility and freshness behavior that must be understood. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
Question 178
A design review evaluates this situation: An Airflow DAG launches a billing aggregation before its source partition arrives, producing empty reports that appear successful. Which shortcut should the team MOST specifically avoid?
- Grant all contributors unrestricted execution and write access to every production dataset.
- Increase retries to hundreds without modifying a non-idempotent target API.
- Edit the running production pipeline by hand and discard the tested artifact identity.
- Set all tasks to run at the same scheduled second and assume dependencies are satisfied.
Explanation
Correct Answer
D:Set all tasks to run at the same scheduled second and assume dependencies are satisfied. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Add supported readiness checks and explicit directed dependencies to the Composer workflow. Why: Orchestration must gate downstream tasks on verified upstream readiness.
Incorrect Answers
A:Grant all contributors unrestricted execution and write access to every production dataset. This addresses a different situation: A team builds new SQL models in a development workspace but schedules them against production datasets using the same credentials. The current scenario instead calls for the more directly applicable unsafe shortcut: Set all tasks to run at the same scheduled second and assume dependencies are satisfied. The reason is that orchestration must gate downstream tasks on verified upstream readiness.
B:Increase retries to hundreds without modifying a non-idempotent target API. This addresses a different situation: A pipeline triggers an invoice-export API and Airflow retries the task after a timeout, sending the same invoice twice. The current scenario instead calls for the more directly applicable unsafe shortcut: Set all tasks to run at the same scheduled second and assume dependencies are satisfied. The reason is that orchestration must gate downstream tasks on verified upstream readiness.
C:Edit the running production pipeline by hand and discard the tested artifact identity. This addresses a different situation: Developers change Dataflow transform logic directly in production with no version tags or regression tests. The current scenario instead calls for the more directly applicable unsafe shortcut: Set all tasks to run at the same scheduled second and assume dependencies are satisfied. The reason is that orchestration must gate downstream tasks on verified upstream readiness.
Question 179
A Google Cloud data engineer is addressing: A Dataflow job in a processing project reads raw data from an ingestion project but uses a broad human administrator credential. Which TWO complementary actions should the team take? Select TWO answers.
- Enable and retain required audit events with protected sinks and monitored access policies.
- Inventory PII fields, consumer roles, retention policies, and approved de-identification requirements.
- Use a dedicated worker service account with minimal permissions on approved source and destination resources.
- Inspect effective org policies, project inheritance, exceptions, and historical resource creation.
- Inspect Dataflow worker identity, source bucket policies, destination dataset grants, and credential handling.
Explanation
Correct Answers
C:Use a dedicated worker service account with minimal permissions on approved source and destination resources. This is the applicable controlled engineering response. Its complementary step is: Inspect Dataflow worker identity, source bucket policies, destination dataset grants, and credential handling. Together they address: Dedicated workload identities with scoped cross-project permissions improve least privilege and lifecycle control.
E:Inspect Dataflow worker identity, source bucket policies, destination dataset grants, and credential handling. This is the applicable diagnostic investigation. Its complementary step is: Use a dedicated worker service account with minimal permissions on approved source and destination resources. Together they address: Dedicated workload identities with scoped cross-project permissions improve least privilege and lifecycle control.
Incorrect Answers
A:Enable and retain required audit events with protected sinks and monitored access policies. This could be useful for another system: A compliance team cannot determine which identity exported a restricted BigQuery customer table last week. For this situation, the necessary paired decisions are to examine (Inspect Dataflow worker identity, source bucket policies, destination dataset grants, and credential handling.) and to implement (Use a dedicated worker service account with minimal permissions on approved source and destination resources.).
B:Inventory PII fields, consumer roles, retention policies, and approved de-identification requirements. This could be useful for another system: Customer support event feeds contain phone numbers and account identifiers, but most analysts require only behavioral aggregates. For this situation, the necessary paired decisions are to examine (Inspect Dataflow worker identity, source bucket policies, destination dataset grants, and credential handling.) and to implement (Use a dedicated worker service account with minimal permissions on approved source and destination resources.).
D:Inspect effective org policies, project inheritance, exceptions, and historical resource creation. This could be useful for another system: Several developer projects can create external IP resources and unrestricted service-account keys even though the organization prohibits them. For this situation, the necessary paired decisions are to examine (Inspect Dataflow worker identity, source bucket policies, destination dataset grants, and credential handling.) and to implement (Use a dedicated worker service account with minimal permissions on approved source and destination resources.).
Question 180
Before modifying the data platform, the team observes: A stream's reported job state stays Running while the actual consumer watermark stops moving for twenty minutes. Which evidence should the engineer examine FIRST?
- Review billing export, job metadata, service identities, and budget alert configuration.
- Inspect Dataflow watermark, Pub/Sub backlog, worker logs, and sink write latency.
- Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message.
- Review assertion outputs, invocation status, SQL failure details, and notification settings.
Explanation
Correct Answer
B:Inspect Dataflow watermark, Pub/Sub backlog, worker logs, and sink write latency. This evidence directly tests the uncertain part of the described system. Pipeline health must include progress, latency, and backlog indicators beyond process liveness. A controlled response is: Alert on sustained lack of event-time progress and remediate the blocking stage.
Incorrect Answers
A:Review billing export, job metadata, service identities, and budget alert configuration. This addresses a different situation: An experimental BigQuery job unexpectedly scans petabytes and costs soar overnight with no spending alerts. The current scenario instead calls for the more directly applicable investigation: Inspect Dataflow watermark, Pub/Sub backlog, worker logs, and sink write latency. The reason is that pipeline health must include progress, latency, and backlog indicators beyond process liveness.
C:Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message. This addresses a different situation: A large BigQuery query fails with resources-exceeded errors and the operator sees only a generic dashboard red indicator. The current scenario instead calls for the more directly applicable investigation: Inspect Dataflow watermark, Pub/Sub backlog, worker logs, and sink write latency. The reason is that pipeline health must include progress, latency, and backlog indicators beyond process liveness.
D:Review assertion outputs, invocation status, SQL failure details, and notification settings. This addresses a different situation: An automated Dataform transform completes, but one critical assertion reports failed rows and no team is notified. The current scenario instead calls for the more directly applicable investigation: Inspect Dataflow watermark, Pub/Sub backlog, worker logs, and sink write latency. The reason is that pipeline health must include progress, latency, and backlog indicators beyond process liveness.