Google Professional Data Engineer Practice Test 61
Question 600
The data engineering team must correct this issue: A Dataform pipeline materializes monthly revenue before its upstream exchange-rate table refresh completes. Which controlled engineering action is MOST appropriate?
- Implement an approved multi-location or recoverable regional design with tested failover and data reconciliation.
- Declare required upstream dependencies and freshness checks before downstream materialization.
- Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates.
- Choose a supported transactional database design and execute related mutations in governed transactions.
Explanation
Correct Answer
B:Declare required upstream dependencies and freshness checks before downstream materialization. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A failed exchange-rate refresh prevents publication of a misleading monthly revenue result. Transformation orchestration must enforce dependency order and freshness contracts.
Incorrect Answers
A:Implement an approved multi-location or recoverable regional design with tested failover and data reconciliation. This addresses a different situation: A regional processing failure stops daily regulatory datasets because all staging, computation, and recovery copies reside in one failure domain. The current scenario instead calls for the more directly applicable engineering action: Declare required upstream dependencies and freshness checks before downstream materialization. The reason is that transformation orchestration must enforce dependency order and freshness contracts.
C:Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates. This addresses a different situation: A nightly sales feed occasionally omits required currency codes, but the current BigQuery load marks every run successful. The current scenario instead calls for the more directly applicable engineering action: Declare required upstream dependencies and freshness checks before downstream materialization. The reason is that transformation orchestration must enforce dependency order and freshness contracts.
D:Choose a supported transactional database design and execute related mutations in governed transactions. This addresses a different situation: An order service needs multi-row transactional correctness, yet engineers propose independent uncoordinated object writes as the system of record. The current scenario instead calls for the more directly applicable engineering action: Declare required upstream dependencies and freshness checks before downstream materialization. The reason is that transformation orchestration must enforce dependency order and freshness contracts.
Question 601
A design review evaluates this situation: A pipeline deployment hardcodes one project ID and dataset location into every query, blocking deployment into another approved region. Which shortcut should the team MOST specifically avoid?
- Claim multi-cloud portability because an undocumented console job can be recreated by memory.
- Size all services from pilot traffic alone and assume they never need architecture changes.
- Edit arbitrary SQL strings manually after each deployment and omit configuration review.
- Make incoming third-party files immediately indistinguishable from certified data.
Explanation
Correct Answer
C:Edit arbitrary SQL strings manually after each deployment and omit configuration review. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Parameterize destination projects and locations through controlled environment configuration. Why: Deployment portability requires parameterized environment-specific resources and validated locations.
Incorrect Answers
A:Claim multi-cloud portability because an undocumented console job can be recreated by memory. This addresses a different situation: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. The current scenario instead calls for the more directly applicable unsafe shortcut: Edit arbitrary SQL strings manually after each deployment and omit configuration review. The reason is that deployment portability requires parameterized environment-specific resources and validated locations.
B:Size all services from pilot traffic alone and assume they never need architecture changes. This addresses a different situation: A pilot warehouse handles thousands of daily events but must support hundreds of millions without rewriting every consuming dashboard. The current scenario instead calls for the more directly applicable unsafe shortcut: Edit arbitrary SQL strings manually after each deployment and omit configuration review. The reason is that deployment portability requires parameterized environment-specific resources and validated locations.
D:Make incoming third-party files immediately indistinguishable from certified data. This addresses a different situation: A company lands vendor extracts directly in curated datasets, making it impossible to distinguish unvalidated source values from approved metrics. The current scenario instead calls for the more directly applicable unsafe shortcut: Edit arbitrary SQL strings manually after each deployment and omit configuration review. The reason is that deployment portability requires parameterized environment-specific resources and validated locations.
Question 602
Before modifying the data platform, the team observes: A Dataform pipeline materializes monthly revenue before its upstream exchange-rate table refresh completes. Which evidence should the engineer examine FIRST?
- Review Dataform dependency definitions, execution timestamps, assertions, and SQL references.
- Review transaction boundaries, read-write patterns, recovery guarantees, and candidate database capabilities.
- Inspect proposed SQL statements, query plans, target datasets, write permissions, and test results.
- Inspect job state, checkpoints, replay source retention, watermarks, and sink write behavior.
Explanation
Correct Answer
A:Review Dataform dependency definitions, execution timestamps, assertions, and SQL references. This evidence directly tests the uncertain part of the described system. Transformation orchestration must enforce dependency order and freshness contracts. A controlled response is: Declare required upstream dependencies and freshness checks before downstream materialization.
Incorrect Answers
B:Review transaction boundaries, read-write patterns, recovery guarantees, and candidate database capabilities. This addresses a different situation: An order service needs multi-row transactional correctness, yet engineers propose independent uncoordinated object writes as the system of record. The current scenario instead calls for the more directly applicable investigation: Review Dataform dependency definitions, execution timestamps, assertions, and SQL references. The reason is that transformation orchestration must enforce dependency order and freshness contracts.
C:Inspect proposed SQL statements, query plans, target datasets, write permissions, and test results. This addresses a different situation: An analytics team uses LLM-generated BigQuery SQL and executes it immediately against production tables with write privileges. The current scenario instead calls for the more directly applicable investigation: Review Dataform dependency definitions, execution timestamps, assertions, and SQL references. The reason is that transformation orchestration must enforce dependency order and freshness contracts.
D:Inspect job state, checkpoints, replay source retention, watermarks, and sink write behavior. This addresses a different situation: A six-hour streaming Dataflow job is relaunched after worker failure and loses uncommitted state when operators create a new pipeline without recovery planning. The current scenario instead calls for the more directly applicable investigation: Review Dataform dependency definitions, execution timestamps, assertions, and SQL references. The reason is that transformation orchestration must enforce dependency order and freshness contracts.
Question 603
A Google Cloud data engineer is addressing: A content pipeline sends customer free-text support tickets to a generative model for categorization without excluding sensitive identifiers. Which TWO complementary actions should the team take? Select TWO answers.
- Inspect ticket contents, model input logs, privacy policies, and enrichment accuracy.
- Configure Apache Beam windows and late-data handling appropriate to the report contract.
- Evolve the schema compatibly or route incompatible versions through a governed mapping.
- Inspect per-key counts, worker utilization, fusion stages, and processing backlog.
- De-identify permitted fields and apply reviewed model categorization with validation and restricted output.
Explanation
Correct Answers
A:Inspect ticket contents, model input logs, privacy policies, and enrichment accuracy. This is the applicable diagnostic investigation. Its complementary step is: De-identify permitted fields and apply reviewed model categorization with validation and restricted output. Together they address: AI-assisted enrichment must enforce input governance, data minimization, and output validation.
E:De-identify permitted fields and apply reviewed model categorization with validation and restricted output. This is the applicable controlled engineering response. Its complementary step is: Inspect ticket contents, model input logs, privacy policies, and enrichment accuracy. Together they address: AI-assisted enrichment must enforce input governance, data minimization, and output validation.
Incorrect Answers
B:Configure Apache Beam windows and late-data handling appropriate to the report contract. This could be useful for another system: A fraud model groups purchases into ten-minute windows, but late device clocks place events into the wrong billing period. For this situation, the necessary paired decisions are to examine (Inspect ticket contents, model input logs, privacy policies, and enrichment accuracy.) and to implement (De-identify permitted fields and apply reviewed model categorization with validation and restricted output.).
C:Evolve the schema compatibly or route incompatible versions through a governed mapping. This could be useful for another system: A partner adds nested JSON attributes to events and downstream parsing jobs fail on unknown fields. For this situation, the necessary paired decisions are to examine (Inspect ticket contents, model input logs, privacy policies, and enrichment accuracy.) and to implement (De-identify permitted fields and apply reviewed model categorization with validation and restricted output.).
D:Inspect per-key counts, worker utilization, fusion stages, and processing backlog. This could be useful for another system: A Dataflow group-by-key stage slows because almost all events share one constant grouping value. For this situation, the necessary paired decisions are to examine (Inspect ticket contents, model input logs, privacy policies, and enrichment accuracy.) and to implement (De-identify permitted fields and apply reviewed model categorization with validation and restricted output.).
Question 604
Before modifying the data platform, the team observes: An automated Dataform transform completes, but one critical assertion reports failed rows and no team is notified. Which evidence should the engineer examine FIRST?
- Review billing export, job metadata, service identities, and budget alert configuration.
- Inspect trace IDs, task run IDs, logging fields, and service timestamps.
- Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message.
- Review assertion outputs, invocation status, SQL failure details, and notification settings.
Explanation
Correct Answer
D:Review assertion outputs, invocation status, SQL failure details, and notification settings. This evidence directly tests the uncertain part of the described system. Data quality assertions require operational ownership and alert routing to prevent incorrect downstream trust. A controlled response is: Configure monitored assertions that block certification and alert accountable data owners.
Incorrect Answers
A:Review billing export, job metadata, service identities, and budget alert configuration. This addresses a different situation: An experimental BigQuery job unexpectedly scans petabytes and costs soar overnight with no spending alerts. The current scenario instead calls for the more directly applicable investigation: Review assertion outputs, invocation status, SQL failure details, and notification settings. The reason is that data quality assertions require operational ownership and alert routing to prevent incorrect downstream trust.
B:Inspect trace IDs, task run IDs, logging fields, and service timestamps. This addresses a different situation: A daily pipeline fails across multiple microservices, but logs cannot connect the initial import to the final BigQuery job. The current scenario instead calls for the more directly applicable investigation: Review assertion outputs, invocation status, SQL failure details, and notification settings. The reason is that data quality assertions require operational ownership and alert routing to prevent incorrect downstream trust.
C:Inspect BigQuery job ID, execution graph, shuffle demand, query text, and error message. This addresses a different situation: A large BigQuery query fails with resources-exceeded errors and the operator sees only a generic dashboard red indicator. The current scenario instead calls for the more directly applicable investigation: Review assertion outputs, invocation status, SQL failure details, and notification settings. The reason is that data quality assertions require operational ownership and alert routing to prevent incorrect downstream trust.
Question 605
Before modifying the data platform, the team observes: An engineer claims an exactly-once Dataflow pipeline makes arbitrary external API side effects impossible to duplicate. Which evidence should the engineer examine FIRST?
- Examine sink contract, retry mechanics, transactional support, and event identifiers.
- Inspect input throughput, worker caps, backpressure metrics, and processing latency.
- Inspect primary business identifiers, source duplicates, merge conditions, and retry logs.
- Inspect object creation events, generation numbers, filename rules, and duplicate triggers.
Explanation
Correct Answer
A:Examine sink contract, retry mechanics, transactional support, and event identifiers. This evidence directly tests the uncertain part of the described system. Pipeline execution guarantees do not automatically make non-idempotent external side effects exactly once. A controlled response is: Build idempotent or transactional external writes with stable business event keys.
Incorrect Answers
B:Inspect input throughput, worker caps, backpressure metrics, and processing latency. This addresses a different situation: During a marketing campaign, Pub/Sub backlog grows and Dataflow workers remain fixed far below incoming throughput. The current scenario instead calls for the more directly applicable investigation: Examine sink contract, retry mechanics, transactional support, and event identifiers. The reason is that pipeline execution guarantees do not automatically make non-idempotent external side effects exactly once.
C:Inspect primary business identifiers, source duplicates, merge conditions, and retry logs. This addresses a different situation: A nightly BigQuery MERGE job occasionally reruns after an orchestrator timeout and inserts duplicate business keys. The current scenario instead calls for the more directly applicable investigation: Examine sink contract, retry mechanics, transactional support, and event identifiers. The reason is that pipeline execution guarantees do not automatically make non-idempotent external side effects exactly once.
D:Inspect object creation events, generation numbers, filename rules, and duplicate triggers. This addresses a different situation: A pipeline should start only after a new approved object lands in a bucket, but currently polls every minute and processes partially copied files. The current scenario instead calls for the more directly applicable investigation: Examine sink contract, retry mechanics, transactional support, and event identifiers. The reason is that pipeline execution guarantees do not automatically make non-idempotent external side effects exactly once.
Question 606
After applying the change, the team re-examines this condition: An analytics contractor needs to query one approved sales dataset, but the administrator proposes granting project-wide BigQuery Admin privileges. Which result BEST verifies the improvement?
- The pipeline succeeds without personal credentials and cannot read an unrelated restricted source.
- A sampled downstream query shows usable aggregates without exposing original phone numbers.
- A standard analyst queries allowed columns but is denied the tagged risk-score column.
- A test identity queries the authorized dataset but cannot read a separate payroll dataset.
Explanation
Correct Answer
D:A test identity queries the authorized dataset but cannot read a separate payroll dataset. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Grant the narrow dataset and job-execution permissions required, avoiding project-wide administration. Dataset-scoped roles limit access without giving users authority over unrelated data or infrastructure.
Incorrect Answers
A:The pipeline succeeds without personal credentials and cannot read an unrelated restricted source. This addresses a different situation: A Dataflow job in a processing project reads raw data from an ingestion project but uses a broad human administrator credential. The current scenario instead calls for the more directly applicable verification result: A test identity queries the authorized dataset but cannot read a separate payroll dataset. The reason is that dataset-scoped roles limit access without giving users authority over unrelated data or infrastructure.
B:A sampled downstream query shows usable aggregates without exposing original phone numbers. This addresses a different situation: Customer support event feeds contain phone numbers and account identifiers, but most analysts require only behavioral aggregates. The current scenario instead calls for the more directly applicable verification result: A test identity queries the authorized dataset but cannot read a separate payroll dataset. The reason is that dataset-scoped roles limit access without giving users authority over unrelated data or infrastructure.
C:A standard analyst queries allowed columns but is denied the tagged risk-score column. This addresses a different situation: Analysts may inspect product transactions but only a small fraud group may see a sensitive risk score in the same table. The current scenario instead calls for the more directly applicable verification result: A test identity queries the authorized dataset but cannot read a separate payroll dataset. The reason is that dataset-scoped roles limit access without giving users authority over unrelated data or infrastructure.
Question 607
Before modifying the data platform, the team observes: A data scientist overwrites a BigQuery ML model each week and has no record of which training window produced the current predictions. Which evidence should the engineer examine FIRST?
- Inspect model creation SQL, source table snapshots, parameters, and evaluation history.
- Review class prevalence, confusion matrix, thresholds, and missed-fraud cost.
- Inspect document types, OCR quality, extracted text, language detection, and document access.
- Inspect preprocessing definitions, feature encodings, input schemas, and deployed inference logic.
Explanation
Correct Answer
A:Inspect model creation SQL, source table snapshots, parameters, and evaluation history. This evidence directly tests the uncertain part of the described system. Model operations need versioned data, training configuration, evaluation, and promotion records. A controlled response is: Record versioned model artifacts and approval criteria with reproducible training inputs.
Incorrect Answers
B:Review class prevalence, confusion matrix, thresholds, and missed-fraud cost. This addresses a different situation: A fraud model reports 99 percent accuracy on data where only one in a thousand transactions is fraudulent. The current scenario instead calls for the more directly applicable investigation: Inspect model creation SQL, source table snapshots, parameters, and evaluation history. The reason is that model operations need versioned data, training configuration, evaluation, and promotion records.
C:Inspect document types, OCR quality, extracted text, language detection, and document access. This addresses a different situation: A records team ingests scanned PDFs for semantic search but indexes raw unreadable binary bytes as if they were meaningful text. The current scenario instead calls for the more directly applicable investigation: Inspect model creation SQL, source table snapshots, parameters, and evaluation history. The reason is that model operations need versioned data, training configuration, evaluation, and promotion records.
D:Inspect preprocessing definitions, feature encodings, input schemas, and deployed inference logic. This addresses a different situation: A production model receives categorical values in a format different from the BigQuery ML training transformations. The current scenario instead calls for the more directly applicable investigation: Inspect model creation SQL, source table snapshots, parameters, and evaluation history. The reason is that model operations need versioned data, training configuration, evaluation, and promotion records.
Question 608
A Google Cloud architecture review finds: Customer support event feeds contain phone numbers and account identifiers, but most analysts require only behavioral aggregates. Which principle BEST explains the underlying data-engineering risk?
- Dedicated workload identities with scoped cross-project permissions improve least privilege and lifecycle control.
- Data residency requirements must govern dataset locations and every replication or processing path.
- Minimizing personal data exposure reduces risk while preserving necessary analytical utility.
- Organization policy constraints complement IAM by preventing disallowed resource configurations.
Explanation
Correct Answer
C:Minimizing personal data exposure reduces risk while preserving necessary analytical utility. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inventory PII fields, consumer roles, retention policies, and approved de-identification requirements. A focused corrective action is: De-identify or tokenize sensitive columns upstream and publish a limited-use analytical dataset.
Incorrect Answers
A:Dedicated workload identities with scoped cross-project permissions improve least privilege and lifecycle control. This addresses a different situation: A Dataflow job in a processing project reads raw data from an ingestion project but uses a broad human administrator credential. The current scenario instead calls for the more directly applicable principle: Minimizing personal data exposure reduces risk while preserving necessary analytical utility. The reason is that minimizing personal data exposure reduces risk while preserving necessary analytical utility.
B:Data residency requirements must govern dataset locations and every replication or processing path. This addresses a different situation: A European customer contract restricts processing and storage to approved locations, while engineers intend to replicate datasets to another continent. The current scenario instead calls for the more directly applicable principle: Minimizing personal data exposure reduces risk while preserving necessary analytical utility. The reason is that minimizing personal data exposure reduces risk while preserving necessary analytical utility.
D:Organization policy constraints complement IAM by preventing disallowed resource configurations. This addresses a different situation: Several developer projects can create external IP resources and unrestricted service-account keys even though the organization prohibits them. The current scenario instead calls for the more directly applicable principle: Minimizing personal data exposure reduces risk while preserving necessary analytical utility. The reason is that minimizing personal data exposure reduces risk while preserving necessary analytical utility.
Question 609
A Google Cloud data engineer is addressing: The same Dataflow template should run in staging and production but contains hardcoded staging bucket names and service-account references. Which TWO complementary actions should the team take? Select TWO answers.
- Use a suitable Google Cloud Workflows definition for the small stateful service chain.
- Publish a tested parameterized template with approved environment configuration.
- Review repository branches, build artifacts, test cases, and environment permissions.
- Implement a governed backfill workflow with bounded concurrent writes and reconciliation.
- Inspect template options, bucket identifiers, worker identities, and region restrictions.
Explanation
Correct Answers
B:Publish a tested parameterized template with approved environment configuration. This is the applicable controlled engineering response. Its complementary step is: Inspect template options, bucket identifiers, worker identities, and region restrictions. Together they address: Reusable deployment artifacts require versioned code plus environment-specific parameterization.
E:Inspect template options, bucket identifiers, worker identities, and region restrictions. This is the applicable diagnostic investigation. Its complementary step is: Publish a tested parameterized template with approved environment configuration. Together they address: Reusable deployment artifacts require versioned code plus environment-specific parameterization.
Incorrect Answers
A:Use a suitable Google Cloud Workflows definition for the small stateful service chain. This could be useful for another system: A lightweight pipeline calls several managed service APIs in order with retry rules, but the team proposes maintaining an entire Airflow deployment for one request chain. For this situation, the necessary paired decisions are to examine (Inspect template options, bucket identifiers, worker identities, and region restrictions.) and to implement (Publish a tested parameterized template with approved environment configuration.).
C:Review repository branches, build artifacts, test cases, and environment permissions. This could be useful for another system: Developers change Dataflow transform logic directly in production with no version tags or regression tests. For this situation, the necessary paired decisions are to examine (Inspect template options, bucket identifiers, worker identities, and region restrictions.) and to implement (Publish a tested parameterized template with approved environment configuration.).
D:Implement a governed backfill workflow with bounded concurrent writes and reconciliation. This could be useful for another system: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. For this situation, the necessary paired decisions are to examine (Inspect template options, bucket identifiers, worker identities, and region restrictions.) and to implement (Publish a tested parameterized template with approved environment configuration.).
Question 610
The data engineering team must correct this issue: A nightly sales feed occasionally omits required currency codes, but the current BigQuery load marks every run successful. Which controlled engineering action is MOST appropriate?
- Choose a supported transactional database design and execute related mutations in governed transactions.
- Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates.
- Use supported Dataflow recovery and replay procedures with independently verified sink idempotency.
- Require human-reviewed read-only dry runs and approved execution boundaries for generated queries.
Explanation
Correct Answer
B:Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A staged file with missing currency codes is blocked or quarantined before reporting. Data validation must verify business semantics, not just successful file ingestion.
Incorrect Answers
A:Choose a supported transactional database design and execute related mutations in governed transactions. This addresses a different situation: An order service needs multi-row transactional correctness, yet engineers propose independent uncoordinated object writes as the system of record. The current scenario instead calls for the more directly applicable engineering action: Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates. The reason is that data validation must verify business semantics, not just successful file ingestion.
C:Use supported Dataflow recovery and replay procedures with independently verified sink idempotency. This addresses a different situation: A six-hour streaming Dataflow job is relaunched after worker failure and loses uncommitted state when operators create a new pipeline without recovery planning. The current scenario instead calls for the more directly applicable engineering action: Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates. The reason is that data validation must verify business semantics, not just successful file ingestion.
D:Require human-reviewed read-only dry runs and approved execution boundaries for generated queries. This addresses a different situation: An analytics team uses LLM-generated BigQuery SQL and executes it immediately against production tables with write privileges. The current scenario instead calls for the more directly applicable engineering action: Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates. The reason is that data validation must verify business semantics, not just successful file ingestion.