Google Professional Data Engineer Practice Test 47
Question 460
A design review evaluates this situation: A research lake contains both public scientific data and restricted patient samples under one bucket with unrestricted reader roles. Which shortcut should the team MOST specifically avoid?
- Delete entire prefixes based only on a name containing temp without ownership review.
- Give everyone bucket-wide read access because most lake files are nonsensitive.
- Keep appending individual records as separate immutable files and assume performance cannot degrade.
- Treat unstructured bucket prefixes as a fully governed enterprise data catalog.
Explanation
Correct Answer
B:Give everyone bucket-wide read access because most lake files are nonsensitive. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Create segregated governed storage or lake access policies with least-privilege permissions. Why: Lake security should enforce data-domain access and classification boundaries.
Incorrect Answers
A:Delete entire prefixes based only on a name containing temp without ownership review. This addresses a different situation: A lake accumulates experimental intermediate outputs that cost more than final retained datasets and lacks automated expiration. The current scenario instead calls for the more directly applicable unsafe shortcut: Give everyone bucket-wide read access because most lake files are nonsensitive. The reason is that lake security should enforce data-domain access and classification boundaries.
C:Keep appending individual records as separate immutable files and assume performance cannot degrade. This addresses a different situation: A Spark job writes millions of tiny Parquet objects, causing large listing overhead and poor query performance across the lake. The current scenario instead calls for the more directly applicable unsafe shortcut: Give everyone bucket-wide read access because most lake files are nonsensitive. The reason is that lake security should enforce data-domain access and classification boundaries.
D:Treat unstructured bucket prefixes as a fully governed enterprise data catalog. This addresses a different situation: Researchers place thousands of raw objects in a data lake and cannot identify schemas, ownership, or classification. The current scenario instead calls for the more directly applicable unsafe shortcut: Give everyone bucket-wide read access because most lake files are nonsensitive. The reason is that lake security should enforce data-domain access and classification boundaries.
Question 461
Before modifying the data platform, the team observes: A managed API intermittently returns 503, causing a multi-step data export workflow to fail permanently without preserving state. Which evidence should the engineer examine FIRST?
- Inspect HTTP status patterns, retry policy, workflow state, and downstream idempotency.
- Inspect Cloud Scheduler timezone, cron expression, daylight rules, and report SLA.
- Examine task graph, partition completeness, retries, and downstream data freshness.
- Review task retries, execution dates, side effects, and idempotency keys.
Explanation
Correct Answer
A:Inspect HTTP status patterns, retry policy, workflow state, and downstream idempotency. This evidence directly tests the uncertain part of the described system. Workflow automation should use bounded backoff and preserve successful prior steps. A controlled response is: Add supported retry conditions and exponential backoff with safe step checkpointing.
Incorrect Answers
B:Inspect Cloud Scheduler timezone, cron expression, daylight rules, and report SLA. This addresses a different situation: A daily report must run at 08:00 business time, but the scheduler is configured in UTC and shifts unexpectedly after regional daylight changes. The current scenario instead calls for the more directly applicable investigation: Inspect HTTP status patterns, retry policy, workflow state, and downstream idempotency. The reason is that workflow automation should use bounded backoff and preserve successful prior steps.
C:Examine task graph, partition completeness, retries, and downstream data freshness. This addresses a different situation: A yearly backfill invokes all daily dependent tasks concurrently, while downstream aggregation assumes every day is already complete. The current scenario instead calls for the more directly applicable investigation: Inspect HTTP status patterns, retry policy, workflow state, and downstream idempotency. The reason is that workflow automation should use bounded backoff and preserve successful prior steps.
D:Review task retries, execution dates, side effects, and idempotency keys. This addresses a different situation: An Airflow DAG reruns after scheduler recovery and reissues the same external billing update twice. The current scenario instead calls for the more directly applicable investigation: Inspect HTTP status patterns, retry policy, workflow state, and downstream idempotency. The reason is that workflow automation should use bounded backoff and preserve successful prior steps.
Question 462
The data engineering team must correct this issue: Thousands of store devices publish small events unpredictably, and downstream systems must process them independently without blocking publishers. Which controlled engineering action is MOST appropriate?
- Use authenticated encrypted transfer into an access-controlled storage landing zone.
- Use a scheduled batch processing workflow with timely validated delivery for monthly reporting.
- Design an approved private or restricted connection with encrypted transfer and scoped workload identity.
- Use Pub/Sub topics and independently scaled subscriptions with monitored consumers.
Explanation
Correct Answer
D:Use Pub/Sub topics and independently scaled subscriptions with monitored consumers. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A simulated burst is buffered and multiple consumers process messages without publisher timeouts. Decoupled messaging can buffer variable event rates and isolate independent consumers.
Incorrect Answers
A:Use authenticated encrypted transfer into an access-controlled storage landing zone. This addresses a different situation: A partner uploads raw customer records by custom API, but the team has not assessed encryption in transit or destination access. The current scenario instead calls for the more directly applicable engineering action: Use Pub/Sub topics and independently scaled subscriptions with monitored consumers. The reason is that decoupled messaging can buffer variable event rates and isolate independent consumers.
B:Use a scheduled batch processing workflow with timely validated delivery for monthly reporting. This addresses a different situation: A monthly tax report is generated once per period, but architects propose a continuously running expensive streaming engine. The current scenario instead calls for the more directly applicable engineering action: Use Pub/Sub topics and independently scaled subscriptions with monitored consumers. The reason is that decoupled messaging can buffer variable event rates and isolate independent consumers.
C:Design an approved private or restricted connection with encrypted transfer and scoped workload identity. This addresses a different situation: An internal ERP system sends sensitive database extracts to Google Cloud but security rules prohibit unrestricted internet endpoints. The current scenario instead calls for the more directly applicable engineering action: Use Pub/Sub topics and independently scaled subscriptions with monitored consumers. The reason is that decoupled messaging can buffer variable event rates and isolate independent consumers.
Question 463
Before modifying the data platform, the team observes: A business data provider wants to revoke a partner's access to an outdated analytics feed without invalidating access for other subscribers. Which evidence should the engineer examine FIRST?
- Review publisher datasets, subscription requirements, usage agreements, and IAM permissions.
- Inspect tenant identifiers, user groups, row access policies, and sample access tests.
- Inspect SQL aggregation grain, underlying table security, authorized view grants, and customer groups.
- Inspect subscriber relationships, listing permissions, audit events, and data ownership.
Explanation
Correct Answer
D:Inspect subscriber relationships, listing permissions, audit events, and data ownership. This evidence directly tests the uncertain part of the described system. Sharing products need subscriber-level lifecycle management and accountable permissions. A controlled response is: Revoke only the affected subscriber grant and publish versioned replacement guidance.
Incorrect Answers
A:Review publisher datasets, subscription requirements, usage agreements, and IAM permissions. This addresses a different situation: Two companies want to share selected curated BigQuery datasets without copying unrestricted source projects into each tenant. The current scenario instead calls for the more directly applicable investigation: Inspect subscriber relationships, listing permissions, audit events, and data ownership. The reason is that sharing products need subscriber-level lifecycle management and accountable permissions.
B:Inspect tenant identifiers, user groups, row access policies, and sample access tests. This addresses a different situation: A SaaS analytics platform hosts multiple tenant records in one BigQuery table, and users may see only their organization's rows. The current scenario instead calls for the more directly applicable investigation: Inspect subscriber relationships, listing permissions, audit events, and data ownership. The reason is that sharing products need subscriber-level lifecycle management and accountable permissions.
C:Inspect SQL aggregation grain, underlying table security, authorized view grants, and customer groups. This addresses a different situation: A service provider exposes aggregate service quality metrics to customers but must not reveal individual employee work records. The current scenario instead calls for the more directly applicable investigation: Inspect subscriber relationships, listing permissions, audit events, and data ownership. The reason is that sharing products need subscriber-level lifecycle management and accountable permissions.
Question 464
A Google Cloud architecture review finds: A six-hour streaming Dataflow job is relaunched after worker failure and loses uncommitted state when operators create a new pipeline without recovery planning. Which principle BEST explains the underlying data-engineering risk?
- Generated SQL needs explicit validation, permission boundaries, and review before modifying governed data.
- Stateful stream reliability depends on supported checkpoint or snapshot recovery and sink semantics.
- Data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
- Transformation orchestration must enforce dependency order and freshness contracts.
Explanation
Correct Answer
B:Stateful stream reliability depends on supported checkpoint or snapshot recovery and sink semantics. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect job state, checkpoints, replay source retention, watermarks, and sink write behavior. A focused corrective action is: Use supported Dataflow recovery and replay procedures with independently verified sink idempotency.
Incorrect Answers
A:Generated SQL needs explicit validation, permission boundaries, and review before modifying governed data. This addresses a different situation: An analytics team uses LLM-generated BigQuery SQL and executes it immediately against production tables with write privileges. The current scenario instead calls for the more directly applicable principle: Stateful stream reliability depends on supported checkpoint or snapshot recovery and sink semantics. The reason is that stateful stream reliability depends on supported checkpoint or snapshot recovery and sink semantics.
C:Data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone. This addresses a different situation: A reporting table is updated from multiple partners, and records arriving days late overwrite newer authoritative versions. The current scenario instead calls for the more directly applicable principle: Stateful stream reliability depends on supported checkpoint or snapshot recovery and sink semantics. The reason is that stateful stream reliability depends on supported checkpoint or snapshot recovery and sink semantics.
D:Transformation orchestration must enforce dependency order and freshness contracts. This addresses a different situation: A Dataform pipeline materializes monthly revenue before its upstream exchange-rate table refresh completes. The current scenario instead calls for the more directly applicable principle: Stateful stream reliability depends on supported checkpoint or snapshot recovery and sink semantics. The reason is that stateful stream reliability depends on supported checkpoint or snapshot recovery and sink semantics.
Question 465
After applying the change, the team re-examines this condition: A reporting team creates a materialized view but expects it to instantaneously reflect every base-table update under all query patterns. Which result BEST verifies the improvement?
- A query reconciles with the underlying table within the documented refresh behavior.
- A malicious test filter is treated as data rather than executing unintended SQL.
- The revised query scans the expected partitions with the same result set.
- A report viewer sees allowed campaign totals but cannot extract protected customer records.
Explanation
Correct Answer
A:A query reconciles with the underlying table within the documented refresh behavior. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Design an eligible materialized aggregation and define an acceptable freshness contract. Materialized views have supported eligibility and freshness behavior that must be understood.
Incorrect Answers
B:A malicious test filter is treated as data rather than executing unintended SQL. This addresses a different situation: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. The current scenario instead calls for the more directly applicable verification result: A query reconciles with the underlying table within the documented refresh behavior. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
C:The revised query scans the expected partitions with the same result set. This addresses a different situation: An analyst filters a partitioned BigQuery table by wrapping the partition column in a complex function and sees a costly full scan. The current scenario instead calls for the more directly applicable verification result: A query reconciles with the underlying table within the documented refresh behavior. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
D:A report viewer sees allowed campaign totals but cannot extract protected customer records. This addresses a different situation: A marketing dashboard in Looker Studio displays performance summaries but the configured data source grants unrestricted access to restricted BigQuery customer fields. The current scenario instead calls for the more directly applicable verification result: A query reconciles with the underlying table within the documented refresh behavior. The reason is that materialized views have supported eligibility and freshness behavior that must be understood.
Question 466
The data engineering team must correct this issue: A historical financial ledger migration matches table row counts but contains changed decimal precision in several high-value transactions. Which controlled engineering action is MOST appropriate?
- Create a phased migration plan with report parity checks, accountable owners, and rollback criteria.
- Evaluate an approved Transfer Appliance or equivalent controlled initial bulk-transfer approach.
- Run field-level and aggregate reconciliation with tolerances defined by financial owners.
- Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies.
Explanation
Correct Answer
C:Run field-level and aggregate reconciliation with tolerances defined by financial owners. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: The migrated ledger matches required currency totals and precision across sampled periods. Migration validation needs business-value reconciliation beyond record counts.
Incorrect Answers
A:Create a phased migration plan with report parity checks, accountable owners, and rollback criteria. This addresses a different situation: A data team migrates an operational reporting platform without identifying owners of critical reports or their acceptance criteria. The current scenario instead calls for the more directly applicable engineering action: Run field-level and aggregate reconciliation with tolerances defined by financial owners. The reason is that migration validation needs business-value reconciliation beyond record counts.
B:Evaluate an approved Transfer Appliance or equivalent controlled initial bulk-transfer approach. This addresses a different situation: A research institute has hundreds of terabytes on isolated storage and cannot upload the first copy within its migration window. The current scenario instead calls for the more directly applicable engineering action: Run field-level and aggregate reconciliation with tolerances defined by financial owners. The reason is that migration validation needs business-value reconciliation beyond record counts.
D:Pilot managed Dataproc execution with approved Cloud Storage staging and tested dependencies. This addresses a different situation: A batch Hadoop estate has custom Spark jobs and HDFS storage tightly coupled to aging servers. The current scenario instead calls for the more directly applicable engineering action: Run field-level and aggregate reconciliation with tolerances defined by financial owners. The reason is that migration validation needs business-value reconciliation beyond record counts.
Question 467
Before modifying the data platform, the team observes: A pipeline should start only after a new approved object lands in a bucket, but currently polls every minute and processes partially copied files. Which evidence should the engineer examine FIRST?
- Examine sink contract, retry mechanics, transactional support, and event identifiers.
- Inspect object creation events, generation numbers, filename rules, and duplicate triggers.
- Review source data dictionary, sample values, load schema options, and rejected row records.
- Compare connector support, transformations, secret storage, and execution SLAs.
Explanation
Correct Answer
B:Inspect object creation events, generation numbers, filename rules, and duplicate triggers. This evidence directly tests the uncertain part of the described system. Event-driven loading needs a clear object-finalization signal and idempotent run identity. A controlled response is: Trigger a verified pipeline on object-finalize events with generation-aware deduplication.
Incorrect Answers
A:Examine sink contract, retry mechanics, transactional support, and event identifiers. This addresses a different situation: An engineer claims an exactly-once Dataflow pipeline makes arbitrary external API side effects impossible to duplicate. The current scenario instead calls for the more directly applicable investigation: Inspect object creation events, generation numbers, filename rules, and duplicate triggers. The reason is that event-driven loading needs a clear object-finalization signal and idempotent run identity.
C:Review source data dictionary, sample values, load schema options, and rejected row records. This addresses a different situation: An external supplier's CSV columns sometimes contain leading-zero product codes that BigQuery autodetection converts to numeric values. The current scenario instead calls for the more directly applicable investigation: Inspect object creation events, generation numbers, filename rules, and duplicate triggers. The reason is that event-driven loading needs a clear object-finalization signal and idempotent run identity.
D:Compare connector support, transformations, secret storage, and execution SLAs. This addresses a different situation: A team has several supported relational sources and needs standard cleansing workflows but maintains dozens of brittle custom extraction scripts. The current scenario instead calls for the more directly applicable investigation: Inspect object creation events, generation numbers, filename rules, and duplicate triggers. The reason is that event-driven loading needs a clear object-finalization signal and idempotent run identity.
Question 468
The data engineering team must correct this issue: Analysts need aggregate insurance-risk reporting while only authorized reviewers may see exact claimant identifiers. Which controlled engineering action is MOST appropriate?
- Rewrite the filter to use an eligible direct partition range predicate where possible.
- Apply supported BigQuery data masking policies and verify behavior for each role.
- Restructure the aggregation and limit after appropriate grouping with efficient filtering.
- Use validated query parameters with reviewed field allowlists and read-only credentials.
Explanation
Correct Answer
B:Apply supported BigQuery data masking policies and verify behavior for each role. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A standard analyst sees permitted masked values while an authorized reviewer sees exact data. Dynamic masking and column access policies can limit sensitive detail without removing analytical utility.
Incorrect Answers
A:Rewrite the filter to use an eligible direct partition range predicate where possible. This addresses a different situation: An analyst filters a partitioned BigQuery table by wrapping the partition column in a complex function and sees a costly full scan. The current scenario instead calls for the more directly applicable engineering action: Apply supported BigQuery data masking policies and verify behavior for each role. The reason is that dynamic masking and column access policies can limit sensitive detail without removing analytical utility.
C:Restructure the aggregation and limit after appropriate grouping with efficient filtering. This addresses a different situation: An analytics query sorts a multi-terabyte table globally before returning 20 leaderboard entries, exhausting resources. The current scenario instead calls for the more directly applicable engineering action: Apply supported BigQuery data masking policies and verify behavior for each role. The reason is that dynamic masking and column access policies can limit sensitive detail without removing analytical utility.
D:Use validated query parameters with reviewed field allowlists and read-only credentials. This addresses a different situation: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. The current scenario instead calls for the more directly applicable engineering action: Apply supported BigQuery data masking policies and verify behavior for each role. The reason is that dynamic masking and column access policies can limit sensitive detail without removing analytical utility.
Question 469
The data engineering team must correct this issue: A reporting table is updated from multiple partners, and records arriving days late overwrite newer authoritative versions. Which controlled engineering action is MOST appropriate?
- Use supported Dataflow recovery and replay procedures with independently verified sink idempotency.
- Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates.
- Implement version-aware merges with authoritative ordering and an auditable correction pathway.
- Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window.
Explanation
Correct Answer
C:Implement version-aware merges with authoritative ordering and an auditable correction pathway. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A late stale update cannot replace a newer approved customer record. Data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
Incorrect Answers
A:Use supported Dataflow recovery and replay procedures with independently verified sink idempotency. This addresses a different situation: A six-hour streaming Dataflow job is relaunched after worker failure and loses uncommitted state when operators create a new pipeline without recovery planning. The current scenario instead calls for the more directly applicable engineering action: Implement version-aware merges with authoritative ordering and an auditable correction pathway. The reason is that data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
B:Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates. This addresses a different situation: A nightly sales feed occasionally omits required currency codes, but the current BigQuery load marks every run successful. The current scenario instead calls for the more directly applicable engineering action: Implement version-aware merges with authoritative ordering and an auditable correction pathway. The reason is that data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
D:Implement deterministic event-key deduplication or idempotent sink semantics with an appropriate replay window. This addresses a different situation: A payments stream retries messages after transient failures, causing duplicate warehouse revenue rows during replay. The current scenario instead calls for the more directly applicable engineering action: Implement version-aware merges with authoritative ordering and an auditable correction pathway. The reason is that data fidelity depends on business-time semantics and conflict-resolution rules rather than arrival order alone.
Question 470
A Google Cloud data engineer is addressing: A global enterprise distributes data ownership to regional teams but needs one standard for naming, retention, and access requests. Which TWO complementary actions should the team take? Select TWO answers.
- Establish federated roles and a platform operating model with common policies and domain exceptions.
- Inspect domain contracts, catalog lineage, global policies, and consumer responsibilities.
- Create an approved Dataplex Catalog classification approach and map existing assets into it.
- Interview regional data owners and examine access approvals, standards, and escalation paths.
- Publish a versioned data contract with quality monitoring and consumer notification.
Explanation
Correct Answers
A:Establish federated roles and a platform operating model with common policies and domain exceptions. This is the applicable controlled engineering response. Its complementary step is: Interview regional data owners and examine access approvals, standards, and escalation paths. Together they address: Federated governance needs clear decision rights, shared policies, and local stewardship.
D:Interview regional data owners and examine access approvals, standards, and escalation paths. This is the applicable diagnostic investigation. Its complementary step is: Establish federated roles and a platform operating model with common policies and domain exceptions. Together they address: Federated governance needs clear decision rights, shared policies, and local stewardship.
Incorrect Answers
B:Inspect domain contracts, catalog lineage, global policies, and consumer responsibilities. This could be useful for another system: Finance and logistics teams publish data independently, but a central team imposes one schema that ignores both domains' definitions. For this situation, the necessary paired decisions are to examine (Interview regional data owners and examine access approvals, standards, and escalation paths.) and to implement (Establish federated roles and a platform operating model with common policies and domain exceptions.).
C:Create an approved Dataplex Catalog classification approach and map existing assets into it. This could be useful for another system: A company acquires another business and wants consistent discovery and access classification across existing BigQuery and Cloud Storage assets. For this situation, the necessary paired decisions are to examine (Interview regional data owners and examine access approvals, standards, and escalation paths.) and to implement (Establish federated roles and a platform operating model with common policies and domain exceptions.).
E:Publish a versioned data contract with quality monitoring and consumer notification. This could be useful for another system: An internal data product is advertised as reliable, but consumers receive schema changes and delayed data without notice. For this situation, the necessary paired decisions are to examine (Interview regional data owners and examine access approvals, standards, and escalation paths.) and to implement (Establish federated roles and a platform operating model with common policies and domain exceptions.).