If a professor were to make as many mistakes as ChatGPT, he'd lose his tenure in a heartbeat. Not that tenure means anything because Jordan Peterson lost his but this is beside the point. In spite of their flaws we need them for looking things up because all the search engines are almost completely worthless now. It's weird: in 2010 you were able to formulate your query as a question and the results were more useful than what ChatGPT spits out now. We're condemned to interacting with a stupid bot now.

I realized that if you ask an LLM about a subject you already know something about, it will state some facts which you can verify to be true or not. First of all, this gives you an indication of the reliability of this answer unto itself. If it lists facts which you know to be true, the other facts are more likely to be true as well. It has simply gathered good information for this query.

Secondly, if it uses deductive reasoning to reach its conclusion, you can simply follow along to verify that it's internally consistent. Thus you can learn new things.

How do you guys feel about using LLMs for search queries?