Any guidance on chunk size how small is

This usually just takes some experimentation

If you can pre-split your inputs into meaningful documents (i.e a document for every section in a manual maybe), this will have a bigger impact