Google Professional Data Engineer Practice Test 36
Question 350
A design review evaluates this situation: Researchers place thousands of raw objects in a data lake and cannot identify schemas, ownership, or classification. Which shortcut should the team MOST specifically avoid?
- Assume increasing total stored bytes proves every expected partition was delivered.
- Treat unstructured bucket prefixes as a fully governed enterprise data catalog.
- Keep appending individual records as separate immutable files and assume performance cannot degrade.
- Rename columns freely and promise consumers will infer which meanings changed.
Explanation
Correct Answer
B:Treat unstructured bucket prefixes as a fully governed enterprise data catalog. This is the unsafe shortcut directly relevant to the stated system. A better approach is: Register lake assets in Dataplex Catalog with curated metadata and governed discovery. Why: A useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage.
Incorrect Answers
A:Assume increasing total stored bytes proves every expected partition was delivered. This addresses a different situation: A data lake ingestion job repeatedly misses one daily source partition yet storage dashboards show only total object count. The current scenario instead calls for the more directly applicable unsafe shortcut: Treat unstructured bucket prefixes as a fully governed enterprise data catalog. The reason is that a useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage.
C:Keep appending individual records as separate immutable files and assume performance cannot degrade. This addresses a different situation: A Spark job writes millions of tiny Parquet objects, causing large listing overhead and poor query performance across the lake. The current scenario instead calls for the more directly applicable unsafe shortcut: Treat unstructured bucket prefixes as a fully governed enterprise data catalog. The reason is that a useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage.
D:Rename columns freely and promise consumers will infer which meanings changed. This addresses a different situation: Multiple departments publish raw JSON to a shared lake with inconsistent field definitions that break downstream reusable tables. The current scenario instead calls for the more directly applicable unsafe shortcut: Treat unstructured bucket prefixes as a fully governed enterprise data catalog. The reason is that a useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage.
Question 351
The data engineering team must correct this issue: Daily vendor deliveries contain multipart files with duplicate names and changing schemas, making ingestion traceability unreliable. Which controlled engineering action is MOST appropriate?
- Adopt versioned landing paths and idempotent manifest processing before transformation.
- Introduce bounded concurrency, checkpointed pagination, and exponential backoff with jitter.
- Design an approved private or restricted connection with encrypted transfer and scoped workload identity.
- Implement versioned reference lookups or temporal enrichment with explicit validity periods.
Explanation
Correct Answer
A:Adopt versioned landing paths and idempotent manifest processing before transformation. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: Re-delivering a file yields a traceable duplicate decision without overwriting certified data. Immutable landing identity and manifest metadata enable replay and operational reconciliation.
Incorrect Answers
B:Introduce bounded concurrency, checkpointed pagination, and exponential backoff with jitter. This addresses a different situation: A customer-relationship API imposes quotas, but ingestion code launches thousands of concurrent requests during a nightly backfill. The current scenario instead calls for the more directly applicable engineering action: Adopt versioned landing paths and idempotent manifest processing before transformation. The reason is that immutable landing identity and manifest metadata enable replay and operational reconciliation.
C:Design an approved private or restricted connection with encrypted transfer and scoped workload identity. This addresses a different situation: An internal ERP system sends sensitive database extracts to Google Cloud but security rules prohibit unrestricted internet endpoints. The current scenario instead calls for the more directly applicable engineering action: Adopt versioned landing paths and idempotent manifest processing before transformation. The reason is that immutable landing identity and manifest metadata enable replay and operational reconciliation.
D:Implement versioned reference lookups or temporal enrichment with explicit validity periods. This addresses a different situation: An IoT pipeline joins fast sensor events to slowly changing asset ownership records and occasionally labels readings with obsolete owners. The current scenario instead calls for the more directly applicable engineering action: Adopt versioned landing paths and idempotent manifest processing before transformation. The reason is that immutable landing identity and manifest metadata enable replay and operational reconciliation.
Question 352
A Google Cloud data engineer is addressing: An internal ERP system sends sensitive database extracts to Google Cloud but security rules prohibit unrestricted internet endpoints. Which TWO complementary actions should the team take? Select TWO answers.
- Measure event arrival, detection SLA, event-time skew, and availability requirements.
- Configure appropriate message retention or raw event archival for replay and recovery.
- Inspect source network route, private connectivity options, service endpoints, and authentication.
- Design an approved private or restricted connection with encrypted transfer and scoped workload identity.
- Introduce bounded concurrency, checkpointed pagination, and exponential backoff with jitter.
Explanation
Correct Answers
C:Inspect source network route, private connectivity options, service endpoints, and authentication. This is the applicable diagnostic investigation. Its complementary step is: Design an approved private or restricted connection with encrypted transfer and scoped workload identity. Together they address: Ingestion networking and encryption must align with connectivity and trust boundaries.
D:Design an approved private or restricted connection with encrypted transfer and scoped workload identity. This is the applicable controlled engineering response. Its complementary step is: Inspect source network route, private connectivity options, service endpoints, and authentication. Together they address: Ingestion networking and encryption must align with connectivity and trust boundaries.
Incorrect Answers
A:Measure event arrival, detection SLA, event-time skew, and availability requirements. This could be useful for another system: A payment service must detect suspicious transaction patterns within seconds rather than after overnight aggregation. For this situation, the necessary paired decisions are to examine (Inspect source network route, private connectivity options, service endpoints, and authentication.) and to implement (Design an approved private or restricted connection with encrypted transfer and scoped workload identity.).
B:Configure appropriate message retention or raw event archival for replay and recovery. This could be useful for another system: A vehicle telemetry stream might need replay after an outage, but source retention expires sooner than the required recovery window. For this situation, the necessary paired decisions are to examine (Inspect source network route, private connectivity options, service endpoints, and authentication.) and to implement (Design an approved private or restricted connection with encrypted transfer and scoped workload identity.).
E:Introduce bounded concurrency, checkpointed pagination, and exponential backoff with jitter. This could be useful for another system: A customer-relationship API imposes quotas, but ingestion code launches thousands of concurrent requests during a nightly backfill. For this situation, the necessary paired decisions are to examine (Inspect source network route, private connectivity options, service endpoints, and authentication.) and to implement (Design an approved private or restricted connection with encrypted transfer and scoped workload identity.).
Question 353
A Google Cloud architecture review finds: A churn model trains on a cancellation timestamp that becomes known only after the customer leaves, producing unrealistic validation accuracy. Which principle BEST explains the underlying data-engineering risk?
- Model operations need versioned data, training configuration, evaluation, and promotion records.
- Unstructured analytics needs extraction, validation, and meaningful text segmentation before embedding.
- RAG retrieval requires appropriately chunked, versioned, permission-filtered document embeddings.
- Predictive features must be available at the intended prediction time to avoid target leakage.
Explanation
Correct Answer
D:Predictive features must be available at the intended prediction time to avoid target leakage. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect feature timestamps, training joins, holdout splits, and online availability. A focused corrective action is: Build point-in-time-correct training examples and retrain with only eligible predictors.
Incorrect Answers
A:Model operations need versioned data, training configuration, evaluation, and promotion records. This addresses a different situation: A data scientist overwrites a BigQuery ML model each week and has no record of which training window produced the current predictions. The current scenario instead calls for the more directly applicable principle: Predictive features must be available at the intended prediction time to avoid target leakage. The reason is that predictive features must be available at the intended prediction time to avoid target leakage.
B:Unstructured analytics needs extraction, validation, and meaningful text segmentation before embedding. This addresses a different situation: A records team ingests scanned PDFs for semantic search but indexes raw unreadable binary bytes as if they were meaningful text. The current scenario instead calls for the more directly applicable principle: Predictive features must be available at the intended prediction time to avoid target leakage. The reason is that predictive features must be available at the intended prediction time to avoid target leakage.
C:RAG retrieval requires appropriately chunked, versioned, permission-filtered document embeddings. This addresses a different situation: A customer-service assistant needs grounded retrieval from updated knowledge articles, but the current index mixes old and current documents without lineage. The current scenario instead calls for the more directly applicable principle: Predictive features must be available at the intended prediction time to avoid target leakage. The reason is that predictive features must be available at the intended prediction time to avoid target leakage.
Question 354
A Google Cloud data engineer is addressing: A popular dashboard repeatedly computes the same large daily summary with strict latency goals, while raw transactional records remain necessary for detail drill-down. Which TWO complementary actions should the team take? Select TWO answers.
- Inspect metric definitions, entity keys, report grain, and slowly changing attributes.
- Review query job priority, resource contention, reservation design, and BI deadlines.
- Review source change history, effective timestamps, invoice event times, and model grain.
- Inspect frequent aggregations, dashboard latency, update frequency, and BigQuery feature support.
- Evaluate an eligible materialized view or governed summary table for common aggregates.
Explanation
Correct Answers
D:Inspect frequent aggregations, dashboard latency, update frequency, and BigQuery feature support. This is the applicable diagnostic investigation. Its complementary step is: Evaluate an eligible materialized view or governed summary table for common aggregates. Together they address: Precomputed summary structures can improve repeated analytical response time where refresh limits and query patterns fit.
E:Evaluate an eligible materialized view or governed summary table for common aggregates. This is the applicable controlled engineering response. Its complementary step is: Inspect frequent aggregations, dashboard latency, update frequency, and BigQuery feature support. Together they address: Precomputed summary structures can improve repeated analytical response time where refresh limits and query patterns fit.
Incorrect Answers
A:Inspect metric definitions, entity keys, report grain, and slowly changing attributes. This could be useful for another system: A retailer mixes orders, customers, products, and daily inventory measures in one wide duplicated table, making every report join and aggregate inconsistently. For this situation, the necessary paired decisions are to examine (Inspect frequent aggregations, dashboard latency, update frequency, and BigQuery feature support.) and to implement (Evaluate an eligible materialized view or governed summary table for common aggregates.).
B:Review query job priority, resource contention, reservation design, and BI deadlines. This could be useful for another system: Interactive analysts share BigQuery capacity with long overnight transformations, causing unpredictable daytime dashboard latencies. For this situation, the necessary paired decisions are to examine (Inspect frequent aggregations, dashboard latency, update frequency, and BigQuery feature support.) and to implement (Evaluate an eligible materialized view or governed summary table for common aggregates.).
C:Review source change history, effective timestamps, invoice event times, and model grain. This could be useful for another system: Customer account tiers change over time but year-old invoices must be reported using the tier effective at the invoice date. For this situation, the necessary paired decisions are to examine (Inspect frequent aggregations, dashboard latency, update frequency, and BigQuery feature support.) and to implement (Evaluate an eligible materialized view or governed summary table for common aggregates.).
Question 355
Before modifying the data platform, the team observes: A data platform expects future multi-cloud processing, but its transformation logic is buried in manual console operations with no versioned definitions. Which evidence should the engineer examine FIRST?
- Review schema versions, producer changes, consumer dependencies, and failed-message records.
- Inspect landing locations, transformation stages, table permissions, and traceability of corrections.
- Review source formats, SQL dialect assumptions, pipeline definitions, and operational dependencies.
- Inventory datasets, owners, classifications, descriptions, and upstream-downstream dependencies.
Explanation
Correct Answer
C:Review source formats, SQL dialect assumptions, pipeline definitions, and operational dependencies. This evidence directly tests the uncertain part of the described system. Portable workflows benefit from declarative, version-controlled transformations and clear service boundaries. A controlled response is: Separate portable transformation logic from provider-specific orchestration and version the deployment configuration.
Incorrect Answers
A:Review schema versions, producer changes, consumer dependencies, and failed-message records. This addresses a different situation: Three applications produce events into a common stream, and one deploys a breaking field rename without notifying downstream consumers. The current scenario instead calls for the more directly applicable investigation: Review source formats, SQL dialect assumptions, pipeline definitions, and operational dependencies. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
B:Inspect landing locations, transformation stages, table permissions, and traceability of corrections. This addresses a different situation: A company lands vendor extracts directly in curated datasets, making it impossible to distinguish unvalidated source values from approved metrics. The current scenario instead calls for the more directly applicable investigation: Review source formats, SQL dialect assumptions, pipeline definitions, and operational dependencies. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
D:Inventory datasets, owners, classifications, descriptions, and upstream-downstream dependencies. This addresses a different situation: Business teams cannot identify which dataset is authoritative for customer retention because copies lack ownership and lineage. The current scenario instead calls for the more directly applicable investigation: Review source formats, SQL dialect assumptions, pipeline definitions, and operational dependencies. The reason is that portable workflows benefit from declarative, version-controlled transformations and clear service boundaries.
Question 356
After applying the change, the team re-examines this condition: An analyst filters a partitioned BigQuery table by wrapping the partition column in a complex function and sees a costly full scan. Which result BEST verifies the improvement?
- A malicious test filter is treated as data rather than executing unintended SQL.
- The top-20 result remains correct while shuffle and sort resource consumption decline.
- A report viewer sees allowed campaign totals but cannot extract protected customer records.
- The revised query scans the expected partitions with the same result set.
Explanation
Correct Answer
D:The revised query scans the expected partitions with the same result set. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Rewrite the filter to use an eligible direct partition range predicate where possible. Partition pruning depends on eligible predicates that the query planner can use.
Incorrect Answers
A:A malicious test filter is treated as data rather than executing unintended SQL. This addresses a different situation: A dashboard generates dynamic SQL by concatenating raw user text into filters and risks malformed or unsafe queries. The current scenario instead calls for the more directly applicable verification result: The revised query scans the expected partitions with the same result set. The reason is that partition pruning depends on eligible predicates that the query planner can use.
B:The top-20 result remains correct while shuffle and sort resource consumption decline. This addresses a different situation: An analytics query sorts a multi-terabyte table globally before returning 20 leaderboard entries, exhausting resources. The current scenario instead calls for the more directly applicable verification result: The revised query scans the expected partitions with the same result set. The reason is that partition pruning depends on eligible predicates that the query planner can use.
C:A report viewer sees allowed campaign totals but cannot extract protected customer records. This addresses a different situation: A marketing dashboard in Looker Studio displays performance summaries but the configured data source grants unrestricted access to restricted BigQuery customer fields. The current scenario instead calls for the more directly applicable verification result: The revised query scans the expected partitions with the same result set. The reason is that partition pruning depends on eligible predicates that the query planner can use.
Question 357
After applying the change, the team re-examines this condition: A data team migrates an operational reporting platform without identifying owners of critical reports or their acceptance criteria. Which result BEST verifies the improvement?
- A changed source record is reflected in the expected warehouse run without a manually copied file.
- Critical business reports reconcile in the destination and owners approve the planned cutover.
- A representative Spark job produces reconciled output and meets its batch deadline.
- Post-cutover row and transaction checks agree and application downtime meets its objective.
Explanation
Correct Answer
B:Critical business reports reconcile in the destination and owners approve the planned cutover. This measures the intended corrected behavior rather than only confirming a setting. Implemented action: Create a phased migration plan with report parity checks, accountable owners, and rollback criteria. Business migration success requires mapped consumers, dependencies, tests, and sign-off.
Incorrect Answers
A:A changed source record is reflected in the expected warehouse run without a manually copied file. This addresses a different situation: An analytics team needs managed recurring imports from an approved external business SaaS source into BigQuery. The current scenario instead calls for the more directly applicable verification result: Critical business reports reconcile in the destination and owners approve the planned cutover. The reason is that business migration success requires mapped consumers, dependencies, tests, and sign-off.
C:A representative Spark job produces reconciled output and meets its batch deadline. This addresses a different situation: A batch Hadoop estate has custom Spark jobs and HDFS storage tightly coupled to aging servers. The current scenario instead calls for the more directly applicable verification result: Critical business reports reconcile in the destination and owners approve the planned cutover. The reason is that business migration success requires mapped consumers, dependencies, tests, and sign-off.
D:Post-cutover row and transaction checks agree and application downtime meets its objective. This addresses a different situation: An enterprise migrates a high-write transactional database to Google Cloud and cannot afford a long source freeze during cutover. The current scenario instead calls for the more directly applicable verification result: Critical business reports reconcile in the destination and owners approve the planned cutover. The reason is that business migration success requires mapped consumers, dependencies, tests, and sign-off.
Question 358
Before modifying the data platform, the team observes: Researchers place thousands of raw objects in a data lake and cannot identify schemas, ownership, or classification. Which evidence should the engineer examine FIRST?
- Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories.
- Inventory object prefixes, formats, source owners, and data classification.
- Review bucket usage, object ages, lineage references, recovery requirements, and storage cost.
- Inspect object locations, bucket IAM, table controls, and data classifications.
Explanation
Correct Answer
B:Inventory object prefixes, formats, source owners, and data classification. This evidence directly tests the uncertain part of the described system. A useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage. A controlled response is: Register lake assets in Dataplex Catalog with curated metadata and governed discovery.
Incorrect Answers
A:Inspect expected partition manifests, arrival timestamps, pipeline logs, and object inventories. This addresses a different situation: A data lake ingestion job repeatedly misses one daily source partition yet storage dashboards show only total object count. The current scenario instead calls for the more directly applicable investigation: Inventory object prefixes, formats, source owners, and data classification. The reason is that a useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage.
C:Review bucket usage, object ages, lineage references, recovery requirements, and storage cost. This addresses a different situation: A lake accumulates experimental intermediate outputs that cost more than final retained datasets and lacks automated expiration. The current scenario instead calls for the more directly applicable investigation: Inventory object prefixes, formats, source owners, and data classification. The reason is that a useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage.
D:Inspect object locations, bucket IAM, table controls, and data classifications. This addresses a different situation: A research lake contains both public scientific data and restricted patient samples under one bucket with unrestricted reader roles. The current scenario instead calls for the more directly applicable investigation: Inventory object prefixes, formats, source owners, and data classification. The reason is that a useful data lake needs catalog metadata and lifecycle governance, not only cheap object storage.
Question 359
The data engineering team must correct this issue: An ecommerce service repeatedly looks up the same short-lived inventory recommendations and overwhelms its primary datastore during traffic peaks. Which controlled engineering action is MOST appropriate?
- Benchmark a compatible AlloyDB deployment with appropriate read pools and operational design.
- Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks.
- Choose a Firestore document model with carefully scoped security rules and indexes.
- Use a suitable Cloud SQL edition and HA configuration with controlled migrations.
Explanation
Correct Answer
B:Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks. This addresses the specific problem while respecting business and technical constraints. Validate it by checking: A simulated cache outage falls back safely without losing authoritative inventory changes. A managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
Incorrect Answers
A:Benchmark a compatible AlloyDB deployment with appropriate read pools and operational design. This addresses a different situation: A PostgreSQL-compatible application has intensive operational transactions plus complex analytical queries and wants compatible managed performance options. The current scenario instead calls for the more directly applicable engineering action: Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks. The reason is that a managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
C:Choose a Firestore document model with carefully scoped security rules and indexes. This addresses a different situation: A mobile field-work app stores flexible nested inspection documents and synchronizes changes through supported client libraries. The current scenario instead calls for the more directly applicable engineering action: Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks. The reason is that a managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
D:Use a suitable Cloud SQL edition and HA configuration with controlled migrations. This addresses a different situation: A small business runs a conventional PostgreSQL order service and needs managed backups and routine high availability without massive global horizontal write scale. The current scenario instead calls for the more directly applicable engineering action: Use supported Memorystore caching with bounded TTL and safe cache-miss fallbacks. The reason is that a managed in-memory cache can reduce repeated reads but must not become the sole durable source of truth.
Question 360
A Google Cloud architecture review finds: A business data provider wants to revoke a partner's access to an outdated analytics feed without invalidating access for other subscribers. Which principle BEST explains the underlying data-engineering risk?
- Data sharing controls must cover export and connector capabilities as well as visible charts.
- Row-level security can enforce tenant-scoped access when identity and policy design are correct.
- Sharing products need subscriber-level lifecycle management and accountable permissions.
- Data publication should distinguish certified, governed outputs from exploratory drafts.
Explanation
Correct Answer
C:Sharing products need subscriber-level lifecycle management and accountable permissions. This principle identifies the relevant workload or governance requirement. The engineer should first examine: Inspect subscriber relationships, listing permissions, audit events, and data ownership. A focused corrective action is: Revoke only the affected subscriber grant and publish versioned replacement guidance.
Incorrect Answers
A:Data sharing controls must cover export and connector capabilities as well as visible charts. This addresses a different situation: An embedded dashboard lets viewers export all underlying data even though contracts permit only monthly aggregates. The current scenario instead calls for the more directly applicable principle: Sharing products need subscriber-level lifecycle management and accountable permissions. The reason is that sharing products need subscriber-level lifecycle management and accountable permissions.
B:Row-level security can enforce tenant-scoped access when identity and policy design are correct. This addresses a different situation: A SaaS analytics platform hosts multiple tenant records in one BigQuery table, and users may see only their organization's rows. The current scenario instead calls for the more directly applicable principle: Sharing products need subscriber-level lifecycle management and accountable permissions. The reason is that sharing products need subscriber-level lifecycle management and accountable permissions.
D:Data publication should distinguish certified, governed outputs from exploratory drafts. This addresses a different situation: A finance department publishes unreviewed experiment tables to the company-wide BI directory and consumers treat them as financial statements. The current scenario instead calls for the more directly applicable principle: Sharing products need subscriber-level lifecycle management and accountable permissions. The reason is that sharing products need subscriber-level lifecycle management and accountable permissions.