Does indexing with and without markdown

yes, it will change which parser is used when using SimpleDirectoryReader

But will it have an impact on how good the responses are? Is there a general preference for LlamaIndex?

Depends on your experience I suppose. Technically using the markdown parser should be better, but I have heard some people mention it could be imrpoved