Claude Certified Architect - Professional v1.0

Page:    1 / 9   
Exam contains 125 questions

You are rolling out monitoring for a Claude-based deployment and must complete the specification steps before instrumenting the deployment.
Which two steps must be completed BEFORE instrumenting the deployment to emit metrics and traces? (Choose two.)
Each correct answer presents part of the solution.

  • A. Document the dashboards, alerts, and runbooks for the on-call rotation that will respond.
  • B. Build the dashboards that surface metrics across slices at the cadence the team operates on.
  • C. Define the service-level objectives (SLOs) and the error budgets the deployment will be held to.
  • D. Tune the alert thresholds based on observed normal-state distributions to reduce false positives.
  • E. Define the metrics and the slices the deployment will monitor across normal and adversarial traffic.


Answer : CE

You are an architect supporting the iteration phase of a deployed Claude-based system.
Which activity most directly fits this phase?

  • A. Discard the evaluation framework and reference set once the deployment is in production, accepting that future iterations will have no structured basis for measuring the impact of changes.
  • B. Rebuild the entire system architecture from scratch at the start of every iteration cycle regardless of what production telemetry, evaluations, and stakeholder feedback indicate is needed.
  • C. Review production telemetry, sampled output evaluations, and stakeholder feedback to identify the highest-impact change for the next cycle, then plan the change against the evaluation framework.
  • D. Stop measuring production outcomes once the deployment has successfully launched, treating the go-live milestone as the end of the evaluation and iteration cycle.


Answer : C

A Claude architect at a health services organization is defining evaluation metrics for a clinical-summary pipeline. The pipeline must remain within a per query cost ceiling and must never surface patient data to unauthorized roles.
Which two metrics directly address these requirements? (Choose two.)

  • A. role-based access-control enforcement rate measured on a red-team dataset
  • B. response latency at the 95th percentile across a one-week sample window
  • C. BLEU score computed against a human-annotated reference summary set
  • D. throughput measured as successful requests processed per minute
  • E. per-query token cost measured against the defined cost ceiling


Answer : AE

A revenue projection assistant has missed its monthly cost target by 38 percent. Profiling shows three contributors: a 6,000-token policy preamble repeated on every call (45 percent of cost), retrieval of historical sales chunks averaging 3,000 tokens per call (30 percent), and inference on a flagship tier model (25 percent). Stakeholders require that projection accuracy remain unchanged.
Which two optimizations should you sequence first to reduce cost without affecting accuracy? (Choose two.)
Each correct answer presents part of the solution.

  • A. Cache common retrieved sales chunks accessed across many of the daily queries.
  • B. Truncate the policy preamble to remove non-essential clauses from the prompt.
  • C. Enable prompt caching on the static policy preamble across the recurring calls.
  • D. Switch the workload to a smaller, faster Claude model tier across all queries.
  • E. Reduce the number of historical sales chunks retrieved across each query run.


Answer : AC

You are operating an interactive assistant whose dominant performance constraint is per-turn latency. Quality on routine turns is already acceptable.
Which configuration adjustment most directly improves latency without disproportionately damaging quality?

  • A. Reduce retrieval depth to the top-k passages that historically cover the answer, and cache stable system-prompt content.
  • B. Increase retrieval depth to the corpus maximum to improve recall regardless of latency.
  • C. Disable prompt caching entirely to ensure fresh context processing on every request, preventing stale prefix content from affecting latency-sensitive interactions.
  • D. Switch every turn to the heaviest available model to maximize output quality, accepting that the increased model latency will worsen the per-turn SLO rather than improve it.


Answer : A

You are evaluating an evaluation set used to score a Claude-based hiring-support tool. The set is drawn from one geographic region and one tenure band.
Which response is most appropriate?

  • A. Expand the evaluation set to cover the geographic regions and tenure bands the tool will serve, and rescore the system on the expanded set before broader release.
  • B. Continue using the narrow evaluation set drawn from one region and one tenure band because the existing benchmark scores are already high on that subset.
  • C. Reduce the evaluation set further to a single demographic subgroup to simplify score interpretation, narrowing coverage rather than expanding it to match the intended user population.
  • D. Discard all quantitative evaluation and replace it with qualitative impressions collected from a small, convenience-selected group that may not represent the tool’s full user population.


Answer : A

You are reviewing instrumentation in a multi-agent system.
Which two findings constitute valid observability gaps in the instrumentation? (Choose two.)
Each correct answer presents a complete solution.

  • A. Model identity and version on each turn are not recorded with the turn artifacts.
  • B. Tool-call payloads and outcomes are recorded with redaction applied to known sensitive fields.
  • C. Latency and token usage on every span are emitted to the central metrics pipeline.
  • D. Request-scoped correlation identifiers do not propagate across agent and tool calls.
  • E. Trace spans for each agent step are exported to the shared distributed-tracing backend.


Answer : AD

You are building an evaluation pipeline for a Claude-based deployment and must complete the specification steps before running the deployment against the dataset.
Which two steps must be completed BEFORE running the deployment against the evaluation dataset? (Choose two.)
Each correct answer presents part of the solution.

  • A. Score the deployment outputs against the reference labels and aggregate the metrics.
  • B. Publish the aggregated metrics to a dashboard and gate releases on threshold checks.
  • C. Review failure cases with subject matter experts to refine the scoring rubric.
  • D. Define the metrics and slices the framework will report across representative, edge, and adversarial cases.
  • E. Curate and label the evaluation dataset to match the defined slices.


Answer : DE

You are identifying the highest-impact optimization for a deployment whose token cost is dominated by a long, repeated system prompt and a large retrieved context per request.
Which optimization most directly targets the dominant cost driver?

  • A. Add additional repeated content to the system prompt to give the model more guidance.
  • B. Increase retrieval depth on every request to maximize recall, worsening the dominant cost driver by adding more retrieved tokens per request rather than reducing them.
  • C. Switch every request to the heaviest available model to maximize output quality, accepting that higher per-request inference cost compounds rather than addresses the dominant cost driver.
  • D. Move the long, repeated system prompt into a cacheable prefix and trim retrieved context to the spans relevant to each query.


Answer : D

An operations engineer reports that a Claude-based pipeline began returning malformed JSON responses after a scheduled maintenance window, causing downstream processing failures.
Which two investigative steps most directly isolate the root cause? (Choose two.)

  • A. Compare the current system prompt and output schema configuration against the last known good version from before the maintenance window.
  • B. Switch to a different Claude model tier to rule out provider-side changes as a contributing factor.
  • C. Increase the max tokens limit to determine whether output truncation is causing incomplete JSON structures.
  • D. Replay a set of premaintenance requests against the current configuration and inspect the raw model output before downstream parsing.
  • E. Clear the prompt cache and resubmit all pending requests to eliminate stale cached prefixes.


Answer : AD

You are running a controlled experiment to compare two prompts and must complete the design steps before executing the experiment.
Which two steps must be completed BEFORE running the experiment with random assignment? (Choose two.)
Each correct answer presents part of the solution.

  • A. Analyze the results against the predefined success metric and significance threshold.
  • B. Determine the minimum detectable effect size and the sample size needed for power.
  • C. Document the recommendation, the trade-offs accepted, and the alternatives considered.
  • D. Decide whether to promote, reject, or iterate the candidate based on the analysis.
  • E. Define the hypothesis and the primary success metric for the comparison.


Answer : BE

An architect is reviewing a Claude-based candidate-screening tool prior to deployment. A stakeholder asserts that because the model was not trained on company data, no bias evaluation is necessary.
Which two responses most accurately challenge this assertion? (Choose two.)

  • A. The model may carry demographic biases from pretraining that manifest in screening outcomes regardless of fine-tuning.
  • B. Transparency obligations are satisfied by disclosing that an AI system is in use, without further evaluation.
  • C. The system should be evaluated on outcome-disparity metrics across protected groups before deployment.
  • D. Fairness testing is required only when the training dataset is known to contain protected-class labels.
  • E. Bias evaluation is unnecessary when the model provider has published a responsible-use policy.


Answer : AC

You are building an ethics review checklist for deployments supported by artificial intelligence (AI).
Which two checks belong on the list? (Choose two.)
Each correct answer presents a complete solution.

  • A. Verify that outputs do not rely on generalizations about people that the underlying data does not support.
  • B. Confirm that vendor licensing terms permit the planned production use of the model.
  • C. Confirm that latency and throughput targets are met across the supported user populations.
  • D. Restrict the ethics review to outputs that exceed a defined model-confidence threshold.
  • E. Confirm that high-impact decisions retain human accountability rather than being attributed to the model.


Answer : AE

You are defining where human review must remain in a planned automated pipeline.
Which placement reflects sound human-in-the-loop design?

  • A. Remove all human review steps from the pipeline to maximize throughput, accepting that high-impact and irreversible actions will be taken without any human approval or oversight.
  • B. Place a human reviewer in the loop for a randomly selected sample of requests, without defining criteria for what the reviewer should check or which output categories require mandatory review.
  • C. Place a human reviewer between the model’s output and any high-impact, irreversible action, with explicit criteria for what the reviewer must check before approval.
  • D. Place a human reviewer only after the irreversible action has already executed, making the review a post-hoc audit rather than a meaningful pre-action check or approval gate.


Answer : C

An engineer inadvertently commits an API key to the repository by placing it in .claude/settings.json.
Which configuration design principle was violated?

  • A. Project-scope configuration should always override user-scope configuration.
  • B. MCP server definitions must reside in environment variables to prevent scope conflicts.
  • C. Credentials must be resolved at runtime from a secret store and never stored in version-controlled files.
  • D. Managed configuration must be applied before project-scope configuration is read.


Answer : C

Page:    1 / 9   
Exam contains 125 questions

Talk to us!


Have any questions or issues ? Please dont hesitate to contact us

Certlibrary.com is owned by MBS Tech Limited: Room 1905 Nam Wo Hong Building, 148 Wing Lok Street, Sheung Wan, Hong Kong. Company registration number: 2310926
Certlibrary doesn't offer Real Microsoft Exam Questions. Certlibrary Materials do not contain actual questions and answers from Cisco's Certification Exams.
CFA Institute does not endorse, promote or warrant the accuracy or quality of Certlibrary. CFA® and Chartered Financial Analyst® are registered trademarks owned by CFA Institute.
Terms & Conditions | Privacy Policy | Amazon Exams | Cisco Exams | CompTIA Exams | Databricks Exams | Fortinet Exams | Google Exams | Microsoft Exams | VMware Exams