Can I use MLM method to fine tune my BERT model, if it was initially trained with natural language inference method?

I am using BERT model for sentence similarity task. However my dataset with sentence is very specific and I want to fine tune my model on it first. My dataset is unlabelled. And BERT model that I want to use was trained with natural language inference method (where sentences are labeled as neutral, entailment or contradiction. I found articles about fine tuning BERT model with MLM method, but I don't think that I can apply to my model since it was trained in different way. Is it correct or MLM is applicable for fine tuning model trained with NLI method?

Topic bert transformer deep-learning nlp machine-learning

Category Data Science

About

Geeks Mental is a community that publishes articles and tutorials about Web, Android, Data Science, new techniques and Linux security.