Other options that I've heard companies consider is Microsoft's Private OpenAI service. So instead of sending LLM calls to the public endpoints, a business can register for private and spin up their own private LLM endpoints.
It really depends on the biz use case and the risk-analysis conducted on it. One for example may want to employ differential privacy (on embeddings or own prompts, or elsewhere) to protect privacy of data subjects.
