Do not infer with AI that which can be queried without.
That's from an internal presentation I gave at HubSpot today.
LLMs are great, but there are a lot of use cases that are much better handled with a structured query (like SQL). It's much more economical, much faster and predictable.
Just because an LLM can potentially answer a question you have by passing a bunch of unstructured text into the context window doesn't mean you should.