Advanced RAG techniques

On 31.01.2024 I gave a talk at Helsinki Applied LLM Meetup about advanced RAG techniques. It was organized by Tuomas Riitola. There were about 30 participants from different industries in Finland. I was the second speaker out of 3 talks where I presented about Advanced RAG techniques. My basic takeaways were:

  • Motivation for RAG by introducing Futucortex (Futurice’s search platform)
  • Getting on the same page about Basic vs Advanced RAG definitions
  • Concrete learnings from building Futucortex
    • Garbage in Garbage out
    • User’s query != user’s intent
    • Semantic search is not a silver bullet
    • Behind every good RAG is a good search
    • Fine tuning vs prompt engineering?