The community members discuss the use of a query engine with GPT-4o. One community member confirms that it has been supported since the beginning. Another community member provides a pip command to install the necessary library, and a code snippet to set up the OpenAI language model with GPT-4o. The other community members express appreciation and note that the process is faster than expected.