NVIDIA NCP-AII Practice Test 100
Question 990
During an NVIDIA AI factory acceptance test, engineers discover: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS. Which TWO complementary elements are needed: the correct technical action and the strongest independent diagnostic evidence? Select TWO answers.
- Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle.
- Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes.
- Inspect dcgmi diag suite results, entity IDs, error logs, driver state and conflicting running workloads.
- Collect optical power and FEC or BER data over representative load, then isolate unsafe optics or fibers.
- Execute sustained HPL trials with validated numerical results, platform telemetry and consistent power constraints.
Explanation
Correct Answers
B:This is the direct operational evidence to investigate: Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS.
E:This is an appropriate correction for Sustained HPL burn-in thermal and numerical health: Execute sustained HPL trials with validated numerical results, platform telemetry and consistent power constraints. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS. The governing mechanism is: High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors.
Incorrect Answers
A:This tempting but unsafe shortcut is not a sufficient remediation for Sustained HPL burn-in thermal and numerical health: Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle. A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS. High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors.
C:That option concerns DCGM active single-node diagnostic suites. High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors.
D:This alternative is relevant to Optical FEC BER validation during burn-in but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: Collect optical power and FEC or BER data over representative load, then isolate unsafe optics or fibers. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS.
Question 991
A production GPU cluster review identifies this condition: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS. Which diagnostic evidence should be obtained FIRST to substantiate the likely fault or configuration gap? Select ONE best answer.
- Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes.
- Inspect long-run NCCL logs, error rate, interconnect counters, rank liveness and timing variation.
- Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle.
- Review transceiver diagnostics, FEC corrected and uncorrectable counters, BER trends and optical power.
Explanation
Correct Answer
A:This is the direct operational evidence to investigate: Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS. The governing mechanism is: High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors.
Incorrect Answers
B:That option concerns Multi-node NCCL repeated burn-in. High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors.
C:This tempting but unsafe shortcut is not a sufficient remediation for Sustained HPL burn-in thermal and numerical health: Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS. The governing mechanism is: High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors. The proportionate action is: Execute sustained HPL trials with validated numerical results, platform telemetry and consistent power constraints.
D:This alternative is relevant to Optical FEC BER validation during burn-in but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: Review transceiver diagnostics, FEC corrected and uncorrectable counters, BER trends and optical power. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS.
Question 992
In a professional AI infrastructure deployment, a technician observes: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS. After corrective work, which observable result BEST confirms that the requirement is met? Select ONE best answer.
- The node sustains approved workload performance without unplanned throttling, errors or facility alarms.
- Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle.
- Each intended GPU successfully initializes and executes a minimal repeatable CUDA workload under its supported stack.
- The cluster completes the approved continuous HPL window with valid results and stable sustained performance.
Explanation
Correct Answer
D:This is an observable verified result, not merely a claimed configuration change: The cluster completes the approved continuous HPL window with valid results and stable sustained performance. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS.
Incorrect Answers
A:This alternative is relevant to GPU thermal power and memory single-node burn-in but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: The node sustains approved workload performance without unplanned throttling, errors or facility alarms. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS.
B:This tempting but unsafe shortcut is not a sufficient remediation for Sustained HPL burn-in thermal and numerical health: Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS. The governing mechanism is: High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors. The proportionate action is: Execute sustained HPL trials with validated numerical results, platform telemetry and consistent power constraints. A direct check is: Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes. The acceptance condition is: The cluster completes the approved continuous HPL window with valid results and stable sustained performance.
C:This alternative is relevant to CUDA device query and kernel smoke tests but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: Each intended GPU successfully initializes and executes a minimal repeatable CUDA workload under its supported stack. Observed scenario: A rack's GPU temperatures steadily rise during back-to-back HPL passes despite good average FLOPS.
Question 993
The cluster operations team needs to evaluate this situation: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs. Which operational response is MOST appropriate to address the root issue? Select ONE best answer.
- Capture a reproducible preflight inventory of node hardware, software, connections and expected acceptance tests.
- Run a representative NeMo or equivalent distributed training smoke and burn-in covering data, communication and checkpoints.
- Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle.
- Execute sustained HPL trials with validated numerical results, platform telemetry and consistent power constraints.
Explanation
Correct Answer
D:This is an appropriate correction for Sustained HPL burn-in thermal and numerical health: Execute sustained HPL trials with validated numerical results, platform telemetry and consistent power constraints. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
Incorrect Answers
A:This alternative is relevant to Cluster-wide preflight hardware inventory but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: Capture a reproducible preflight inventory of node hardware, software, connections and expected acceptance tests. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
B:This alternative is relevant to NeMo distributed training end-to-end burn-in but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: Run a representative NeMo or equivalent distributed training smoke and burn-in covering data, communication and checkpoints. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
C:This tempting but unsafe shortcut is not a sufficient remediation for Sustained HPL burn-in thermal and numerical health: Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle. A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
Question 994
At a multi-node AI infrastructure handoff, the team records: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs. Which underlying infrastructure principle BEST explains the issue? Select ONE best answer.
- Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle.
- End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests.
- High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors.
- A representative performance benchmark is meaningful only when the tested hardware and software baseline are documented.
Explanation
Correct Answer
C:This is the governing infrastructure principle: High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
Incorrect Answers
A:This tempting but unsafe shortcut is not a sufficient remediation for Sustained HPL burn-in thermal and numerical health: Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle. A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs. High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors.
B:This alternative is relevant to NeMo distributed training end-to-end burn-in but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
D:This alternative is relevant to Cluster-wide preflight hardware inventory but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: A representative performance benchmark is meaningful only when the tested hardware and software baseline are documented. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
Question 995
During an NVIDIA AI factory acceptance test, engineers discover: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs. Which diagnostic evidence should be obtained FIRST to substantiate the likely fault or configuration gap? Select ONE best answer.
- Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle.
- Inspect GPU temperature and power traces, clock throttle reasons, error counters and completed stress duration.
- Inspect HPL output for residual tests, return codes, numerical anomalies and rerun consistency.
- Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes.
Explanation
Correct Answer
D:This is the direct operational evidence to investigate: Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
Incorrect Answers
A:This tempting but unsafe shortcut is not a sufficient remediation for Sustained HPL burn-in thermal and numerical health: Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs. The governing mechanism is: High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors. The proportionate action is: Execute sustained HPL trials with validated numerical results, platform telemetry and consistent power constraints.
B:This alternative is relevant to GPU thermal power and memory single-node burn-in but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: Inspect GPU temperature and power traces, clock throttle reasons, error counters and completed stress duration. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
C:This alternative is relevant to HPL numerical result and residual validation but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: Inspect HPL output for residual tests, return codes, numerical anomalies and rerun consistency. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
Question 996
A production GPU cluster review identifies this condition: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs. After corrective work, which observable result BEST confirms that the requirement is met? Select ONE best answer.
- The cluster completes the approved continuous HPL window with valid results and stable sustained performance.
- The link maintains vendor-supported signal margin and acceptable bit-error behavior during sustained traffic.
- The node sustains approved workload performance without unplanned throttling, errors or facility alarms.
- Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle.
Explanation
Correct Answer
A:This is an observable verified result, not merely a claimed configuration change: The cluster completes the approved continuous HPL window with valid results and stable sustained performance. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
Incorrect Answers
B:This alternative is relevant to Optical FEC BER validation during burn-in but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: The link maintains vendor-supported signal margin and acceptable bit-error behavior during sustained traffic. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
C:This alternative is relevant to GPU thermal power and memory single-node burn-in but does not directly resolve the current Sustained HPL burn-in thermal and numerical health issue: The node sustains approved workload performance without unplanned throttling, errors or facility alarms. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs.
D:This tempting but unsafe shortcut is not a sufficient remediation for Sustained HPL burn-in thermal and numerical health: Report the best HPL number as full reliability evidence even if later long-run trials fail or throttle. Observed scenario: A datacenter accepts a one-time HPL score without checking stability across powered full-cluster runs. The governing mechanism is: High FLOPS does not prove durable cluster stability; repeated HPL can reveal thermal and computational errors. The proportionate action is: Execute sustained HPL trials with validated numerical results, platform telemetry and consistent power constraints. A direct check is: Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes. The acceptance condition is: The cluster completes the approved continuous HPL window with valid results and stable sustained performance.
Question 997
In a professional AI infrastructure deployment, a technician observes: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading. Which operational response is MOST appropriate to address the root issue? Select ONE best answer.
- Run a controlled representative GPU stress with monitoring of temperatures, memory and power-limit behavior.
- Select a representative supported HPL problem size and process layout, then report achieved and reference performance honestly.
- Run a representative NeMo or equivalent distributed training smoke and burn-in covering data, communication and checkpoints.
- Assume an excellent NCCL all-reduce result guarantees that any real multi-node LLM training pipeline will succeed.
Explanation
Correct Answer
C:This is an appropriate correction for NeMo distributed training end-to-end burn-in: Run a representative NeMo or equivalent distributed training smoke and burn-in covering data, communication and checkpoints. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
Incorrect Answers
A:This alternative is relevant to GPU thermal power and memory single-node burn-in but does not directly resolve the current NeMo distributed training end-to-end burn-in issue: Run a controlled representative GPU stress with monitoring of temperatures, memory and power-limit behavior. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
B:This alternative is relevant to HPL configuration matrix dimensions and performance but does not directly resolve the current NeMo distributed training end-to-end burn-in issue: Select a representative supported HPL problem size and process layout, then report achieved and reference performance honestly. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
D:This tempting but unsafe shortcut is not a sufficient remediation for NeMo distributed training end-to-end burn-in: Assume an excellent NCCL all-reduce result guarantees that any real multi-node LLM training pipeline will succeed.
Question 998
The cluster operations team needs to evaluate this situation: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading. Which underlying infrastructure principle BEST explains the issue? Select ONE best answer.
- HPL measures achieved dense linear-algebra throughput under a specific matrix and process mapping, not marketing peak clocks.
- End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests.
- Sustained accelerator load can reveal thermal and electrical limits not visible during idle or brief smoke checks.
- Assume an excellent NCCL all-reduce result guarantees that any real multi-node LLM training pipeline will succeed.
Explanation
Correct Answer
B:This is the governing infrastructure principle: End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
Incorrect Answers
A:That option concerns HPL configuration matrix dimensions and performance. The acceptance condition is: The target model workflow trains for the planned duration and produces recoverable checkpoints without systemic faults.
C:This alternative is relevant to GPU thermal power and memory single-node burn-in but does not directly resolve the current NeMo distributed training end-to-end burn-in issue: Sustained accelerator load can reveal thermal and electrical limits not visible during idle or brief smoke checks. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
D:This tempting but unsafe shortcut is not a sufficient remediation for NeMo distributed training end-to-end burn-in: Assume an excellent NCCL all-reduce result guarantees that any real multi-node LLM training pipeline will succeed. End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests.
Question 999
At a multi-node AI infrastructure handoff, the team records: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading. Which diagnostic evidence should be obtained FIRST to substantiate the likely fault or configuration gap? Select ONE best answer.
- Inspect dcgmi diag suite results, entity IDs, error logs, driver state and conflicting running workloads.
- Review training step timing, data-loader health, collective logs, checkpoint round trip and worker errors.
- Assume an excellent NCCL all-reduce result guarantees that any real multi-node LLM training pipeline will succeed.
- Inspect GPU temperature and power traces, clock throttle reasons, error counters and completed stress duration.
Explanation
Correct Answer
B:This is the direct operational evidence to investigate: Review training step timing, data-loader health, collective logs, checkpoint round trip and worker errors. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
Incorrect Answers
A:This alternative is relevant to DCGM active single-node diagnostic suites but does not directly resolve the current NeMo distributed training end-to-end burn-in issue: Inspect dcgmi diag suite results, entity IDs, error logs, driver state and conflicting running workloads. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
C:This tempting but unsafe shortcut is not a sufficient remediation for NeMo distributed training end-to-end burn-in: Assume an excellent NCCL all-reduce result guarantees that any real multi-node LLM training pipeline will succeed. All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
D:This alternative is relevant to GPU thermal power and memory single-node burn-in but does not directly resolve the current NeMo distributed training end-to-end burn-in issue: Inspect GPU temperature and power traces, clock throttle reasons, error counters and completed stress duration. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
Question 1000
During an NVIDIA AI factory acceptance test, engineers discover: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading. Which THREE elements together establish the appropriate corrective action, independent test evidence and verified successful outcome? Select THREE answers.
- Run a representative NeMo or equivalent distributed training smoke and burn-in covering data, communication and checkpoints.
- Inspect per-iteration residual status, achieved FLOPS, GPU errors, thermal trend and job exit codes.
- Assume an excellent NCCL all-reduce result guarantees that any real multi-node LLM training pipeline will succeed.
- The target model workflow trains for the planned duration and produces recoverable checkpoints without systemic faults.
- Plan approved-duration coordinated burn-in with continuous telemetry and clean test resource reservations.
- Review training step timing, data-loader health, collective logs, checkpoint round trip and worker errors.
Explanation
Correct Answers
A:This is an appropriate correction for NeMo distributed training end-to-end burn-in: Run a representative NeMo or equivalent distributed training smoke and burn-in covering data, communication and checkpoints. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading. The governing mechanism is: End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests.
D:This is an observable verified result, not merely a claimed configuration change: The target model workflow trains for the planned duration and produces recoverable checkpoints without systemic faults. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.
F:This is the direct operational evidence to investigate: Review training step timing, data-loader health, collective logs, checkpoint round trip and worker errors. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading. The governing mechanism is: End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests.
Incorrect Answers
B:That option concerns Sustained HPL burn-in thermal and numerical health. End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests.
C:This tempting but unsafe shortcut is not a sufficient remediation for NeMo distributed training end-to-end burn-in: Assume an excellent NCCL all-reduce result guarantees that any real multi-node LLM training pipeline will succeed. All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading. End-to-end AI training exercises compute, storage, network and software coordination differently from synthetic NCCL tests.
E:This alternative is relevant to Long-duration burn-in schedule and symptom correlation but does not directly resolve the current NeMo distributed training end-to-end burn-in issue: Plan approved-duration coordinated burn-in with continuous telemetry and clean test resource reservations. Observed scenario: All-reduce benchmarks pass but a real distributed NeMo training job fails on checkpoint data loading.