Those of you who use NLP models in production, how do you monitor them? I'm looking at deploying my own gpt-style nlp model soon, and I couldn't find many monitoring tools like one would find with http libraries, etc.
How do you guys monitor your nlp models in production, and what metrics/aspects of the model do you monitor?