Advanced RAG techniques
On 31.01.2024 I gave a talk at Helsinki Applied LLM Meetup about advanced RAG techniques. It was organized by Tuomas Riitola. There were about 30 participants from different industries in Finland. I was the second speaker out of 3 talks where I presented about Advanced RAG techniques. My basic takeaways were:
- Motivation for RAG by introducing Futucortex (Futurice’s search platform)
- Getting on the same page about Basic vs Advanced RAG definitions
- Concrete learnings from building Futucortex
- Garbage in Garbage out
- User’s query != user’s intent
- Semantic search is not a silver bullet
- Behind every good RAG is a good search
- Fine tuning vs prompt engineering?