Is there a way to monitor the cost of

You can use observation tools like Arize phoenix or Langfuse which will give you an idea of how much tokens are being used per query.