Analyses Customization

Three analyses can be configured in Azimuth. Go to each relevant section to know more about the different attributes that can be defined.

Class DefinitionConfig Example

class PerturbationTestingScope(ModelContractConfig):
    behavioral_testing: Optional[BehavioralTestingOptions] = Field(
        BehavioralTestingOptions(), env="BEHAVIORAL_TESTING"
    )


class SimilarityConfig(CommonFieldsConfig):
    similarity: Optional[SimilarityOptions] = Field(
        SimilarityOptions(), env="SIMILARITY")


class DatasetWarningConfig(CommonFieldsConfig):
    dataset_warnings: DatasetWarningsOptions = DatasetWarningsOptions()

This will disable both behavioral testing and similarity analysis in Azimuth.

{
  "behavioral_testing": null,
  "similarity": null
}