ISTQB Certified Tester - AI Testing v1.0

Page:    1 / 8   
Exam contains 119 questions

Which ONE of the below types of testing is NOT a type of experience-based testing applied to an AI-based system?

  • A. Exploring training data to understand its variety, patterns, structure and shape - then using that to inform testing
  • B. Usability testing of the format of the output predictions
  • C. Using knowledge about previous ML systems to identify potential biases
  • D. Using an industry checklist to assess the steps used to prepare an ML system


Answer : D

A robotic AI-based system is being built by a logistics company to operate within its unmanned warehouses. The warehouses can all be very different and new ones are being added each year. It is expected that the system will not require retraining for each warehouse, and will be able to learn the location of different items and move them to specified locations on request.
Which ONE of the following attributes should be MOST carefully considered when specifying the objectives and acceptance criteria for the system?

  • A. Inappropriate bias
  • B. Adaptability
  • C. Ethics
  • D. Explainability


Answer : B

Which ONE of the below statements BEST describes why test environments for autonomous systems might need to be different to other test environments?

  • A. Tools may be required to simulate extreme scenarios
  • B. Non-determinism may need to be introduced into the environment
  • C. AI-specific hardware may be required
  • D. Tools may be required to provide explanations of system behavior


Answer : A

Which ONE of the following would be the LEAST effective input to an AI-based test optimization process?

  • A. Previously failing tests
  • B. Defect reports
  • C. Test environment downtime
  • D. Source control data


Answer : C

Which ONE of the following statements is true about dynamic testing for inappropriate bias?

  • A. It can be necessary to obtain additional attributes about the data being processed
  • B. Reviewing the source of the training data can reveal inappropriate bias
  • C. Inappropriate bias only needs to be tested when protected characteristics such as race and gender are present in the inputs
  • D. Testing should never be conducted in production


Answer : A

Which ONE of the following options for a test basis would give the LEAST coverage when using AI-based test generation?

  • A. A test model describing the application functionality
  • B. A list of possible web pages that comprise the application
  • C. A pseudo-oracle
  • D. An XML schema


Answer : D

Which ONE of the following would be the MOST effective input to an AI-based defect prediction tool?

  • A. Developers associated with previous code changes
  • B. Cyclomatic complexity
  • C. Lines of code changed
  • D. Commit size


Answer : B

In which ONE of the following situations would an ML model be MOST effective at determining the criticality of new defects?

  • A. A new application which is in the early stages of the first test cycle
  • B. An old application with lots of defect records but a brand new development and test team
  • C. An old application where defect records are linked to failed tests and production incidents
  • D. An old application with few critical defect records and many non-critical defect records


Answer : C

Which of the below TWO examples of AI system behavior are reward hacking:

1. An AI medical device intended to keep a patient stable may give the patient a treatment that means they recover less quickly.
2. An AI system intended to maximize production of a commodity by weight allows quality and size of product to reduce.
3. An AI system intended to ensure the output of a factory process is always sorted correctly, destroys the outputs.
4. An AI system intended to remove security vulnerabilities from software code, removes all functionality that has security vulnerabilities.

  • A. 1, 2
  • B. 1, 3
  • C. 3, 4
  • D. 2, 4


Answer : A

A neural network has been designed and created to assist day-traders improve efficiency when buying and selling commodities in a rapidly changing market. Suppose the test team executes a test on the neural network where each neuron is examined. For this network the shortest path indicates a buy, and it will only occur when the one-day predicted value of the commodity is greater than the spot price by 0.75%. The neurons are stimulated by entering commodity prices and testers verify that they activate only when the future value exceeds the spot price by at least 0.75%.

Which of the following statements BEST explains the type of coverage being tested on the neural network?

  • A. Threshold coverage
  • B. Neuron coverage
  • C. Sign-change coverage 5
  • D. Value-change coverage


Answer : A

Which of the following is one of the reasons for data mislabeling?

  • A. Lack of domain knowledge
  • B. Expert knowledge
  • C. Interoperability error
  • D. Small datasets


Answer : A

You have access to the training data that was used to train an AI-based system. You can review this information and use it as a guideline when creating your tests. What type of characteristic is this?

  • A. Autonomy
  • B. Explorability
  • C. Transparency
  • D. Accessibility


Answer : C

Which of the following is a problem with AI-generated test cases that are generated from the requirements?

  • A. They are slow and will usually not be able to execute in the time allowed
  • B. They are defect prone because they are unable to detect nuances in the requirements
  • C. They make debugging more complicated because the number of steps is usually high in order to induce the target failure
  • D. They are usually missing the expected results, so verification is difficult or must resort to only detecting significant failures


Answer : D

You are testing an autonomous vehicle which uses AI to determine proper driving actions and responses. You have evaluated the parameters and combinations to be tested and have determined that there are too many to test in the time allowed.

It has been suggested that you use pairwise testing to limit the parameters. Given the complexity of the software under test, what is likely the outcome from using pairwise testing?

  • A. The number of parameters to test can be reduced to less than a dozen
  • B. All high priority defects will be identified using this method
  • C. While the number of tests needed can be reduced, there may still be a large enough set of tests that automation will be required to execute all of them
  • D. Pairwise cannot be applied to this problem because there is AI involved and the evolving values may result in unexpected results that cannot be verified


Answer : C

Which of the following aspects in a challenge when handling test data for an AI-based system?

  • A. Personal data or confidential data
  • B. Output data or intermediate data
  • C. Video frame speed or aspect ratio
  • D. Data frameworks or machine learning frameworks


Answer : A

Page:    1 / 8   
Exam contains 119 questions

Talk to us!


Have any questions or issues ? Please dont hesitate to contact us

Certlibrary.com is owned by MBS Tech Limited: Room 1905 Nam Wo Hong Building, 148 Wing Lok Street, Sheung Wan, Hong Kong. Company registration number: 2310926
Certlibrary doesn't offer Real Microsoft Exam Questions. Certlibrary Materials do not contain actual questions and answers from Cisco's Certification Exams.
CFA Institute does not endorse, promote or warrant the accuracy or quality of Certlibrary. CFA® and Chartered Financial Analyst® are registered trademarks owned by CFA Institute.
Terms & Conditions | Privacy Policy | Amazon Exams | Cisco Exams | CompTIA Exams | Databricks Exams | Fortinet Exams | Google Exams | Microsoft Exams | VMware Exams