Chatbot to act as an assistant to engineering teams
Διπλωματική Εργασία
| Επιβλέπων | Παναγιώτης Τσανάκας |
|---|---|
| Συσχετιζόμενο μάθημα | Αλληλεπίδραση Ανθρώπου - Υπολογιστή |
Περιγραφή
Foundation large language models (LLM), such as GPT-4 and Llama2, can answer general knowledge questions and even exhibit reasoning abilities. However, they lack context specific knowledge that can be found in business organizations internal documents. The information contained in the foundation models can be extended by using context material and so called Fine Tuning or retrieval augmented generation (RAG). [2]
Following this reasoning we want to develop a chatbot that shall act as an assistant to engineering teams that install, configure, customize and provide technical support for Intracom Telecom’s BigData platform. The chatbot shall use open source LLM and Retrieval Augmented Generation (RAG) to answer user queries about the specific knowledge base that comprises of the documentation corpus of the BigData platform and the database of Service Requests (SRs) from customers. The scope of the project includes the design, implementation, testing, evaluation and optimization of the chatbot using algorithms and open source frameworks that provide automation of the tasks.
References
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks https://research.facebook.com/file/4283170945104179/Retrieval-Augmented-Generation-for-Knowledge-Intensive-NLP-Tasks.pdf
- Chatbots in Knowledge-Intensive Contexts: Comparing Intent and LLM-Based Systems, https://arxiv.org/abs/2402.04955
- Build a contextual chatbot application using Knowledge Bases for Amazon Bedrock https://aws.amazon.com/blogs/machine-learning/build-a-contextual-chatbot-application-using-knowledge-bases-for-amazon-bedrock/
- Large Language Models as Optimizers https://arxiv.org/abs/2309.03409
- RAG Evaluation https://huggingface.co/learn/cookbook/rag_evaluation
Επιθυμητές γνώσεις
- Python programming in Linux (required)
- Basic practical knowledge in NLP (Natural Language Processing) like here: https://huggingface.co/learn/nlp-course/chapter1/1
- Knowledge of Langchain https://python.langchain.com/docs/get_started/introduction
Επικοινωνία: Νικόλαος Ευθυμίου (nikolaos.efthimiou@intracom-telecom.com)
Παναγιώτης Τσανάκας (panag@cs.ntua.gr)