Find answers from the community

Updated 5 months ago

anyone know why `index =

At a glance

The community member is encountering a TypeError: Object of type datetime is not JSON serializable exception when trying to serialize documents from a Discord data reader. The issue is caused by the Discord loader inserting datetime objects into the metadata, which cannot be serialized. To fix this, the community member suggests iterating through the documents and converting the datetime objects to strings before serializing them. Another community member agrees that this is a good solution to the issue.

ssegfault

anyone know why index = VectorStoreIndex.from_documents(documents) might be raising a TypeError: Object of type datetime is not JSON serializable exception when tring to serialize the documents from:

Plain Text

reader = DiscordReader(discord_token=discord_token)
documents = reader.load_data(channel_ids=channel_ids)

5 comments

LLogan M

Seems like the metadata needs to be a string, and it sounds like the discord loader is inserting datetime objects into the metadata

ssegfault

oh so i have to modify the discord loader possibly then @Logan M ? I was trying to find any mention of date time in the discord loader source but i could not find any

ssegfault

update:
in order to fix this issue (which is caused by a bug in the library)
I had to itterate the documents and convert the dates to strings

Plain Text

# fix date time encoding
for doc in documents:
    doc.metadata['created_at'] = json.dumps(doc.metadata['created_at'],default=str)
    doc.metadata['edited_at'] = json.dumps(doc.metadata['edited_at'],default=str)

LLogan M

Yea the latter is more what I meant as a fix 👍

ssegfault

i should probably make a pr for the discord data connector

Add a reply