Google Professional Data Engineer Practice Test 60
Question 590
A Google Cloud architecture review finds: Developers change Dataflow transform logic directly in production with no version tags or regression tests. Which principle BEST explains the underlying data-engineering risk?
- Data pipeline CI/CD should validate schema, code, and deployment before production promotion.
- Reusable deployment artifacts require versioned code plus environment-specific parameterization.
- Production scheduling should use maintained workload identities and explicit ownership.
- Backfill orchestration needs controlled concurrency and partition-level change coordination.
Explanation
Correct Answer
A:Data pipeline CI/CD should validate schema, code, and deployment before production promotion. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Review repository branches, build artifacts, test cases, and environment permissions. A focused corrective action is: Add a reviewed CI pipeline with unit/integration tests and controlled Dataflow template promotion.
Incorrect Answers
B:Reusable deployment artifacts require versioned code plus environment-specific parameterization. This addresses a different situation: The same Dataflow template should run in staging and production but contains hardcoded staging bucket names and service-account references. The current scenario instead calls for the more directly applicable principle: Data pipeline CI/CD should validate schema, code, and deployment before production promotion. The reason is that data pipeline CI/CD should validate schema, code, and deployment before production promotion.
C:Production scheduling should use maintained workload identities and explicit ownership. This addresses a different situation: A recurring transformation runs under the credentials of a departed analyst and begins failing when the account is disabled. The current scenario instead calls for the more directly applicable principle: Data pipeline CI/CD should validate schema, code, and deployment before production promotion. The reason is that data pipeline CI/CD should validate schema, code, and deployment before production promotion.
D:Backfill orchestration needs controlled concurrency and partition-level change coordination. This addresses a different situation: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. The current scenario instead calls for the more directly applicable principle: Data pipeline CI/CD should validate schema, code, and deployment before production promotion. The reason is that data pipeline CI/CD should validate schema, code, and deployment before production promotion.
Question 591
The data engineering team must correct this issue: Customer support event feeds contain phone numbers and account identifiers, but most analysts require only behavioral aggregates. Which controlled engineering action is MOST appropriate?
- De-identify or tokenize sensitive columns upstream and publish a limited-use analytical dataset.
- Grant the narrow dataset and job-execution permissions required, avoiding project-wide administration.
- Apply approved column policy tags and corresponding fine-grained access controls.
- Select compliant regional resources and constrain replication, jobs, and exports to approved locations.
Explanation
Correct Answer
A:De-identify or tokenize sensitive columns upstream and publish a limited-use analytical dataset. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A sampled downstream query shows usable aggregates without exposing original phone numbers. Minimizing personal data exposure reduces risk while preserving necessary analytical utility.
Incorrect Answers
B:Grant the narrow dataset and job-execution permissions required, avoiding project-wide administration. This addresses a different situation: An analytics contractor needs to query one approved sales dataset, but the administrator proposes granting project-wide BigQuery Admin privileges. The current scenario instead calls for the more directly applicable engineering action: De-identify or tokenize sensitive columns upstream and publish a limited-use analytical dataset. The reason is that minimizing personal data exposure reduces risk while preserving necessary analytical utility.
C:Apply approved column policy tags and corresponding fine-grained access controls. This addresses a different situation: Analysts may inspect product transactions but only a small fraud group may see a sensitive risk score in the same table. The current scenario instead calls for the more directly applicable engineering action: De-identify or tokenize sensitive columns upstream and publish a limited-use analytical dataset. The reason is that minimizing personal data exposure reduces risk while preserving necessary analytical utility.
D:Select compliant regional resources and constrain replication, jobs, and exports to approved locations. This addresses a different situation: A European customer contract restricts processing and storage to approved locations, while engineers intend to replicate datasets to another continent. The current scenario instead calls for the more directly applicable engineering action: De-identify or tokenize sensitive columns upstream and publish a limited-use analytical dataset. The reason is that minimizing personal data exposure reduces risk while preserving necessary analytical utility.
Question 592
Before modifying the data platform, the team observes: A payment streaming system is operationally critical, but monthly experimentation triggers heavy resource contention and delayed settlement events. Which evidence should the engineer examine FIRST?
- Review reservation assignments, edition capacity, slot utilization, and job priorities.
- Inspect query job priorities, deadlines, slot utilization, and reservation assignments.
- Review reservation assignments, burst schedule, idle capacity, and job limits.
- Inspect queue lag, concurrency controls, reservation usage, and critical event SLAs.
Explanation
Correct Answer
D:Inspect queue lag, concurrency controls, reservation usage, and critical event SLAs. This evidence directly tests the uncertain part of the described system. Business-critical data processing should have planned resource isolation and failover controls. A controlled response is: Protect streaming settlement capacity and schedule noncritical experiments appropriately.
Incorrect Answers
A:Review reservation assignments, edition capacity, slot utilization, and job priorities. This addresses a different situation: Critical dashboards compete with scheduled ETL jobs for BigQuery slots and miss interactive latency targets. The current scenario instead calls for the more directly applicable investigation: Inspect queue lag, concurrency controls, reservation usage, and critical event SLAs. The reason is that business-critical data processing should have planned resource isolation and failover controls.
B:Inspect query job priorities, deadlines, slot utilization, and reservation assignments. This addresses a different situation: A same-day executive dashboard competes with a large nonurgent nightly historical rebuild. The current scenario instead calls for the more directly applicable investigation: Inspect queue lag, concurrency controls, reservation usage, and critical event SLAs. The reason is that business-critical data processing should have planned resource isolation and failover controls.
C:Review reservation assignments, burst schedule, idle capacity, and job limits. This addresses a different situation: A data science team needs occasional huge feature-engineering runs but competes with a permanently reserved reporting workload. The current scenario instead calls for the more directly applicable investigation: Inspect queue lag, concurrency controls, reservation usage, and critical event SLAs. The reason is that business-critical data processing should have planned resource isolation and failover controls.
Question 593
A Google Cloud architecture review finds: A historical backfill and regular hourly ingestion overlap on the same BigQuery partitions, creating conflicting writes. Which principle BEST explains the underlying data-engineering risk?
- Data pipeline CI/CD should validate schema, code, and deployment before production promotion.
- Backfill orchestration needs controlled concurrency and partition-level change coordination.
- Production scheduling should use maintained workload identities and explicit ownership.
- Orchestration must gate downstream tasks on verified upstream readiness.
Explanation
Correct Answer
B:Backfill orchestration needs controlled concurrency and partition-level change coordination. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect scheduler overlap, destination write disposition, backfill ranges, and task locks. A focused corrective action is: Implement a governed backfill workflow with bounded concurrent writes and reconciliation.
Incorrect Answers
A:Data pipeline CI/CD should validate schema, code, and deployment before production promotion. This addresses a different situation: Developers change Dataflow transform logic directly in production with no version tags or regression tests. The current scenario instead calls for the more directly applicable principle: Backfill orchestration needs controlled concurrency and partition-level change coordination. The reason is that backfill orchestration needs controlled concurrency and partition-level change coordination.
C:Production scheduling should use maintained workload identities and explicit ownership. This addresses a different situation: A recurring transformation runs under the credentials of a departed analyst and begins failing when the account is disabled. The current scenario instead calls for the more directly applicable principle: Backfill orchestration needs controlled concurrency and partition-level change coordination. The reason is that backfill orchestration needs controlled concurrency and partition-level change coordination.
D:Orchestration must gate downstream tasks on verified upstream readiness. This addresses a different situation: An Airflow DAG launches a billing aggregation before its source partition arrives, producing empty reports that appear successful. The current scenario instead calls for the more directly applicable principle: Backfill orchestration needs controlled concurrency and partition-level change coordination. The reason is that backfill orchestration needs controlled concurrency and partition-level change coordination.
Question 594
Before modifying the data platform, the team observes: An enterprise migrates a high-write transactional database to Google Cloud and cannot afford a long source freeze during cutover. Which evidence should the engineer examine FIRST?
- Inspect source log retention, CDC offsets, snapshot timing, and destination reconciliation.
- Inspect source database capabilities, replication lag, schema compatibility, and cutover windows.
- Measure data size, network capacity, security policy, available time, and checksum requirements.
- Review source system connector support, synchronization frequency, credentials, and dataset location.
Explanation
Correct Answer
B:Inspect source database capabilities, replication lag, schema compatibility, and cutover windows. This evidence directly tests the uncertain part of the described system. Low-downtime database migration needs ongoing change capture, validation, and controlled application switchover. A controlled response is: Use a supported Database Migration Service path and a rehearsed switchover with reconciliation.
Incorrect Answers
A:Inspect source log retention, CDC offsets, snapshot timing, and destination reconciliation. This addresses a different situation: A retail database migration captures historical tables but fails to process updates made after the initial snapshot. The current scenario instead calls for the more directly applicable investigation: Inspect source database capabilities, replication lag, schema compatibility, and cutover windows. The reason is that low-downtime database migration needs ongoing change capture, validation, and controlled application switchover.
C:Measure data size, network capacity, security policy, available time, and checksum requirements. This addresses a different situation: A research institute has hundreds of terabytes on isolated storage and cannot upload the first copy within its migration window. The current scenario instead calls for the more directly applicable investigation: Inspect source database capabilities, replication lag, schema compatibility, and cutover windows. The reason is that low-downtime database migration needs ongoing change capture, validation, and controlled application switchover.
D:Review source system connector support, synchronization frequency, credentials, and dataset location. This addresses a different situation: An analytics team needs managed recurring imports from an approved external business SaaS source into BigQuery. The current scenario instead calls for the more directly applicable investigation: Inspect source database capabilities, replication lag, schema compatibility, and cutover windows. The reason is that low-downtime database migration needs ongoing change capture, validation, and controlled application switchover.
Question 595
Before modifying the data platform, the team observes: Several developer projects can create external IP resources and unrestricted service-account keys even though the organization prohibits them. Which evidence should the engineer examine FIRST?
- Check data classifications, policy tags, user groups, dataset roles, and sample SELECT permissions.
- Inspect effective org policies, project inheritance, exceptions, and historical resource creation.
- Inspect projects, dataset names, service-account scopes, deployment permissions, and audit activity.
- Inspect the contractor's tasks, project IAM bindings, dataset permissions, and audit logs.
Explanation
Correct Answer
B:Inspect effective org policies, project inheritance, exceptions, and historical resource creation. This evidence directly tests the uncertain part of the described system. Organization policy constraints complement IAM by preventing disallowed resource configurations. A controlled response is: Apply reviewed organization policies at the appropriate hierarchy scope and document approved exemptions.
Incorrect Answers
A:Check data classifications, policy tags, user groups, dataset roles, and sample SELECT permissions. This addresses a different situation: Analysts may inspect product transactions but only a small fraud group may see a sensitive risk score in the same table. The current scenario instead calls for the more directly applicable investigation: Inspect effective org policies, project inheritance, exceptions, and historical resource creation. The reason is that organization policy constraints complement IAM by preventing disallowed resource configurations.
C:Inspect projects, dataset names, service-account scopes, deployment permissions, and audit activity. This addresses a different situation: Developers test destructive transformations against the same production dataset used for regulatory reporting. The current scenario instead calls for the more directly applicable investigation: Inspect effective org policies, project inheritance, exceptions, and historical resource creation. The reason is that organization policy constraints complement IAM by preventing disallowed resource configurations.
D:Inspect the contractor's tasks, project IAM bindings, dataset permissions, and audit logs. This addresses a different situation: An analytics contractor needs to query one approved sales dataset, but the administrator proposes granting project-wide BigQuery Admin privileges. The current scenario instead calls for the more directly applicable investigation: Inspect effective org policies, project inheritance, exceptions, and historical resource creation. The reason is that organization policy constraints complement IAM by preventing disallowed resource configurations.
Question 596
The data engineering team must correct this issue: A monthly tax report is generated once per period, but architects propose a continuously running expensive streaming engine. Which controlled engineering action is MOST appropriate?
- Implement versioned reference lookups or temporal enrichment with explicit validity periods.
- Use a scheduled batch processing workflow with timely validated delivery for monthly reporting.
- Use Pub/Sub and an appropriately configured Dataflow stream with an approved low-latency sink.
- Adopt versioned landing paths and idempotent manifest processing before transformation.
Explanation
Correct Answer
B:Use a scheduled batch processing workflow with timely validated delivery for monthly reporting. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: The report is complete by its business deadline without paying for idle streaming resources. Processing mode should reflect data freshness requirements and operating cost.
Incorrect Answers
A:Implement versioned reference lookups or temporal enrichment with explicit validity periods. This addresses a different situation: An IoT pipeline joins fast sensor events to slowly changing asset ownership records and occasionally labels readings with obsolete owners. The current scenario instead calls for the more directly applicable engineering action: Use a scheduled batch processing workflow with timely validated delivery for monthly reporting. The reason is that processing mode should reflect data freshness requirements and operating cost.
C:Use Pub/Sub and an appropriately configured Dataflow stream with an approved low-latency sink. This addresses a different situation: A payment service must detect suspicious transaction patterns within seconds rather than after overnight aggregation. The current scenario instead calls for the more directly applicable engineering action: Use a scheduled batch processing workflow with timely validated delivery for monthly reporting. The reason is that processing mode should reflect data freshness requirements and operating cost.
D:Adopt versioned landing paths and idempotent manifest processing before transformation. This addresses a different situation: Daily vendor deliveries contain multipart files with duplicate names and changing schemas, making ingestion traceability unreliable. The current scenario instead calls for the more directly applicable engineering action: Use a scheduled batch processing workflow with timely validated delivery for monthly reporting. The reason is that processing mode should reflect data freshness requirements and operating cost.
Question 597
The data engineering team must correct this issue: A pipeline should start only after a new approved object lands in a bucket, but currently polls every minute and processes partially copied files. Which controlled engineering action is MOST appropriate?
- Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution.
- Build idempotent or transactional external writes with stable business event keys.
- Trigger a verified pipeline on object-finalize events with generation-aware deduplication.
- Introduce a valid temporal side input or keyed lookup with explicit late-reference reconciliation.
Explanation
Correct Answer
C:Trigger a verified pipeline on object-finalize events with generation-aware deduplication. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: One completed object starts exactly one effective processing run while temporary files are ignored. Event-driven loading needs a clear object-finalization signal and idempotent run identity.
Incorrect Answers
A:Use appropriately sized ephemeral Dataproc job clusters or serverless Spark execution. This addresses a different situation: A once-weekly Spark transformation uses a permanently running Dataproc cluster that sits idle most of the week. The current scenario instead calls for the more directly applicable engineering action: Trigger a verified pipeline on object-finalize events with generation-aware deduplication. The reason is that event-driven loading needs a clear object-finalization signal and idempotent run identity.
B:Build idempotent or transactional external writes with stable business event keys. This addresses a different situation: An engineer claims an exactly-once Dataflow pipeline makes arbitrary external API side effects impossible to duplicate. The current scenario instead calls for the more directly applicable engineering action: Trigger a verified pipeline on object-finalize events with generation-aware deduplication. The reason is that event-driven loading needs a clear object-finalization signal and idempotent run identity.
D:Introduce a valid temporal side input or keyed lookup with explicit late-reference reconciliation. This addresses a different situation: Device readings arrive every second but the related factory equipment registration data changes hourly, producing joins with missing references. The current scenario instead calls for the more directly applicable engineering action: Trigger a verified pipeline on object-finalize events with generation-aware deduplication. The reason is that event-driven loading needs a clear object-finalization signal and idempotent run identity.
Question 598
The data engineering team must correct this issue: A lakehouse platform keeps Parquet in Cloud Storage but wants managed governance across BigQuery and compatible external engines. Which controlled engineering action is MOST appropriate?
- Choose a Firestore document model with carefully scoped security rules and indexes.
- Apply the approved Cloud Storage retention or hold mechanism with formal change control.
- Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks.
- Create supported BigLake tables and verified catalog grants for authorized engines.
Explanation
Correct Answer
D:Create supported BigLake tables and verified catalog grants for authorized engines. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: Authorized tools query the same governed lake dataset while restricted identities are denied. BigLake can provide managed table access and governance for eligible lake data across processing systems.
Incorrect Answers
A:Choose a Firestore document model with carefully scoped security rules and indexes. This addresses a different situation: A mobile field-work app stores flexible nested inspection documents and synchronizes changes through supported client libraries. The current scenario instead calls for the more directly applicable engineering action: Create supported BigLake tables and verified catalog grants for authorized engines. The reason is that bigLake can provide managed table access and governance for eligible lake data across processing systems.
B:Apply the approved Cloud Storage retention or hold mechanism with formal change control. This addresses a different situation: A legal investigation requires evidence objects to remain unchanged for a prescribed duration, while administrators can currently delete them. The current scenario instead calls for the more directly applicable engineering action: Create supported BigLake tables and verified catalog grants for authorized engines. The reason is that bigLake can provide managed table access and governance for eligible lake data across processing systems.
C:Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks. This addresses a different situation: An ecommerce service repeatedly looks up the same short-lived inventory recommendations and overwhelms its primary datastore during traffic peaks. The current scenario instead calls for the more directly applicable engineering action: Create supported BigLake tables and verified catalog grants for authorized engines. The reason is that bigLake can provide managed table access and governance for eligible lake data across processing systems.
Question 599
A Google Cloud architecture review finds: A production relational data source resides on a single-zone Cloud SQL instance and a zone outage stops all ingestion. Which principle BEST explains the underlying data-engineering risk?
- High availability plans must address actual zonal failure domains and tested recovery behavior.
- Disaster-recovery readiness requires explicit source replay, state reconciliation, and executable failover runbooks.
- Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data.
- Analytical recovery requires independently retained copies and known restore procedures that meet policy.
Explanation
Correct Answer
A:High availability plans must address actual zonal failure domains and tested recovery behavior. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Review availability configuration, application connection recovery, backups, and zone dependencies. A focused corrective action is: Configure supported regional high availability and test application reconnection.
Incorrect Answers
B:Disaster-recovery readiness requires explicit source replay, state reconciliation, and executable failover runbooks. This addresses a different situation: A critical Pub/Sub-to-warehouse flow has a secondary-region deployment template but no retained state, failover routing, or test exercise. The current scenario instead calls for the more directly applicable principle: High availability plans must address actual zonal failure domains and tested recovery behavior. The reason is that high availability plans must address actual zonal failure domains and tested recovery behavior.
C:Reliable pipelines need quarantine, lineage, rollback, and source replay plans for corrupted data. This addresses a different situation: An upstream vendor accidentally publishes a corrupted schema version and downstream totals become wrong before anyone notices. The current scenario instead calls for the more directly applicable principle: High availability plans must address actual zonal failure domains and tested recovery behavior. The reason is that high availability plans must address actual zonal failure domains and tested recovery behavior.
D:Analytical recovery requires independently retained copies and known restore procedures that meet policy. This addresses a different situation: A finance warehouse needs recoverable reporting after regional disruption but keeps its only critical dataset in one region. The current scenario instead calls for the more directly applicable principle: High availability plans must address actual zonal failure domains and tested recovery behavior. The reason is that high availability plans must address actual zonal failure domains and tested recovery behavior.
Question 600
The data engineering team must correct this issue: A Dataform pipeline materializes monthly revenue before its upstream exchange-rate table refresh completes. Which controlled engineering action is MOST appropriate?
- Implement an approved multi-location or recoverable regional design with tested failover and data reconciliation.
- Declare required upstream dependencies and freshness checks before downstream materialization.
- Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates.
- Choose a supported transactional database design and execute related mutations in governed transactions.
Explanation
Correct Answer
B:Declare required upstream dependencies and freshness checks before downstream materialization. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A failed exchange-rate refresh prevents publication of a misleading monthly revenue result. Transformation orchestration must enforce dependency order and freshness contracts.
Incorrect Answers
A:Implement an approved multi-location or recoverable regional design with tested failover and data reconciliation. This addresses a different situation: A regional processing failure stops daily regulatory datasets because all staging, computation, and recovery copies reside in one failure domain. The current scenario instead calls for the more directly applicable engineering action: Declare required upstream dependencies and freshness checks before downstream materialization. The reason is that transformation orchestration must enforce dependency order and freshness contracts.
C:Add schema and domain-value assertions that quarantine invalid rows and fail critical data-quality gates. This addresses a different situation: A nightly sales feed occasionally omits required currency codes, but the current BigQuery load marks every run successful. The current scenario instead calls for the more directly applicable engineering action: Declare required upstream dependencies and freshness checks before downstream materialization. The reason is that transformation orchestration must enforce dependency order and freshness contracts.
D:Choose a supported transactional database design and execute related mutations in governed transactions. This addresses a different situation: An order service needs multi-row transactional correctness, yet engineers propose independent uncoordinated object writes as the system of record. The current scenario instead calls for the more directly applicable engineering action: Declare required upstream dependencies and freshness checks before downstream materialization. The reason is that transformation orchestration must enforce dependency order and freshness contracts.