Have Your Attention on What Is