In a significant advancement for banking technology, the developers of Advanced RAG, Dima Anikeenko and Semen Semeikin, have unveiled a new intelligent search tool that promises to revolutionize how information is accessed within Alfa-Bank. This innovative system enhances the conventional smart search, known as RAG, by integrating an additional layer of local knowledge, allowing for quicker and more accurate responses to customer inquiries.
The Advanced RAG employs a large language model (LLM) that not only retrieves answers but also understands the context of the questions being asked. This technology aims to reduce the time taken for bank employees to find relevant information, thereby improving efficiency. Traditionally, a contact center operator would spend about a minute searching for answers in a knowledge base, but with the implementation of Advanced RAG, this process can be completed in just 15 seconds.
One of the key features of this system is its ability to pull information from specific databases, such as Confluence and Jira, which are tailored to Alfa-Bank's projects. This specificity ensures that responses are not only accurate but also relevant to the current operational context of the bank. However, the developers acknowledge that successful implementation requires a deep understanding of both the architecture of their system and the integration of various data streams.
The architecture of Advanced RAG includes around 20 microservices, with a focus on optimizing data retrieval and processing. The developers have utilized Qdrant, a sharded database that facilitates faster search capabilities by organizing different domains of knowledge on separate shards. Additionally, they have introduced synthetic chunks—additional context generated by the LLM during data loading—which help anticipate user inquiries more effectively.
While the technology is promising, the developers caution that simply deploying Qdrant is not enough. To achieve effective search results, a comprehensive understanding of language model operations and proper integration with data processing is essential. They emphasize the importance of a user-friendly interface and a clear vision of user needs to ensure the product remains relevant and in demand.
As Advanced RAG sets a new standard for intelligent search in banking, this innovation positions Alfa-Bank as a leader in the financial technology sector. Competitors will need to adapt quickly to these advancements to maintain their market positions and continue meeting evolving customer expectations.
Informational material. 18+.
