There are several corner cases. For example consider this code:

>>> class C:
...     del __annotations__
...     x: int

Currently this correctly raises NameError, with your replacement it will instead stick {'x': int} in the module `__annotations__`. I think there may be other special cases but I don't remember them now.