Metric drops to 0 while fitting and stay there

Hey everyone, this has happened to me a couple of times now and I dont realize why.

Throughout fitting a pretrained model from huggingface (but also happened on own models) the metric (not only my custom metric, but also accuracy etc.) suddenly drop to 0 at a random epoch (sometimes 3rd, sometimes 4th, sometimes another..) and doesnt return.
Why could this be, do you have any ideas how to avoid this? train / test and overall hyperparameters work on other pretrained model without failure.

https://preview.redd.it/zm0cyhpb18591.png?width=1465&format=png&auto=webp&s=2ac1259ad6358f54eb7121f333201d351da6cc60