I am not commenting on the case itself which you can read for example here, but just thinking about how good an AI, such as a chatbot, with a Human Interface is:

• writes / talks as or better than an average human
• is very convincing
• answers questions on everything (knows it all!)
• provides references (if asked) about anything, even imaginary!
• is always available and answers within a few seconds
• is very good at explaining
• etc.

How can we not trust it?