Reduce performance impact of compiler.enable decorator (deepspeedai#7498)

For some accelerators (such as HPU) running in a non-compile scenarios,
the `compiler.enable` decorator can cause significant performance drops
up to 8-12%.

We can easily avoid the performance hit in non-compile scenarios, by
detecting the ongoing compilation and returning immediately.

Signed-off-by: Max Kovalenko <[email protected]>
Co-authored-by: Olatunji Ruwase <[email protected]>
Signed-off-by: lym <[email protected]>

Author: 2 people

deepspeed/runtime/compiler.py

@@ -49,6 +49,8 @@ def another_function():
     """
 
     def decorator(func):
+        if not is_compiling():
+            return func
 
         @functools.wraps(func)
         def wrapper(*args, **kwargs):