How do you plan on adding extra features to a BERT model? BERT only takes in text as inputs. You could give it other things but it wouldn’t really know what to do with them.

You can use BERT as part of a larger model which also considers other features though.