Thanks for pointing that out @jlweiss! And thanks for the screenshot @Hristo_Velev, I see what you mean now. There’s currently no way to customize the cards themselves, so for the time being hopefully displaying the Task detail page rather than the linked entity detail page will give you a little more control over what you want displayed.
It’d be worth submitting your idea as a feature request so the product team can take it into account whenever they turn their attention to My Tasks.