His son and grandson also became caliphs