The talk will briefly discuss techniques from explainable AI and demonstrate its use for validating and understanding physical models.