Knowledge of Transformers