You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The op F.contrib.BilinearResize2D need to explicitly know the destination size, so the segmentation models is not hybridized now in order to dynamically determine the destination size.
I think we should hybridize the models later to improve performance and reduce memory consuming.
The text was updated successfully, but these errors were encountered:
I searched online for a while, and it seems MXNet is not thread-safe. So the training of semantic segmentation models is not hybridizable, as long as we need syncbn. It will throw a bug something like this,
AttributeError: 'NoneType' object has no attribute '*exit*'
The inference of semantic segmentation is hybridizable though.
Maybe we can do local distributed training style instead of multithreading
The SyncBN is implemented in operator level, which does not support distributed training. The synchronization happens within the operator and bypass the engine.
The op F.contrib.BilinearResize2D need to explicitly know the destination size, so the segmentation models is not hybridized now in order to dynamically determine the destination size.
I think we should hybridize the models later to improve performance and reduce memory consuming.
The text was updated successfully, but these errors were encountered: