Improving user experience and client engagement in IT with generative AI

Executive summary

Client background

Our client is a global company that provides a wide range of software engineering services. With more than 20 locations around the globe, it provides its broad expertise to industry leaders and Fortune 500 companies worldwide.

Business challenge

The client wanted to streamline and automate responding to inquiries from potential clients on their website and make interactions more engaging.

Value delivered

Sparknet has developed an OpenAI API-powered sales assistant (chatbot) and implemented it on the client’s website. It made interactions with potential clients faster, easier, and more engaging.

 

Success story in detail

Business challenge: improving client engagement on the company’s website

The client wanted to streamline the communication with visitors on their website. There was a lot of useful information on the website (case studies, expertise pages, etc.), but the search engine could direct their end customers only to the first most relevant piece of content. As a result, the client’s engagement managers had to spend significant time providing their customers with information that was already available on the website (specifically during initial interactions). Therefore, the client aimed to implement an intelligent chatbot solution powered by generative AI to answer user inquiries quickly, showcase the company’s expertise and help engage new clients.

Sparknet approach: conducting a thorough analysis and build a PoC

We began by performing a thorough analysis of the client’s needs aimed at investigating the following crucial points:

  • How to build an internal base of text files that would serve as a cooperative knowledge base?
  • How to make responses the most relevant to the clients’ needs?
  • How to provide text indexing so that the relevant information can be quickly found and analyzed by the system?
  • How to ensure quick 1-2 second responses?
  • What are the estimated costs of implementing such a solution?
  • How to protect sensitive internal information?

Based on the conducted analysis, we have developed a PoC of the script that was running on the client’s website and parsed information from the website pages. The script could analyze data, identify which data is relevant to the user’s question, and provide short, concise answers.

Implementation: designing and implementing a sales assistant (chatbot) powered by OpenAI API

We have developed a sales assistant chatbot based on OpenAI API version 4 and introduced it on the main page of the client’s website. This chatbot allows users to receive accurate information about the client’s expertise, industries and technologies they work with, services they provide, etc.

On the backend side, we have developed a corporate knowledge base (based on vector database) that contains information from the website and internal documentation. This documentation is hosted in the AWS corporate account. Therefore, each time a user submits a question to the sales assistant, the system receives the user’s question and the context from the corporate knowledge base. Next, the LlamaIndex library indexes the text files from the knowledge base and selects only the ones that are relevant to the question. Finally, OpenAI and Langchain processes the indexed context and sends a short and concise answer to the chatbot.

We utilized embedding models in the LlamaIndex library to quickly and efficiently process the files in the knowledge base, index them, and select the details relevant to the question.

To make the solution as cost-effective as possible, we have set up limits on the amount of inquiries users can make per day. We have also ensured high levels of data protection by implementing firewalls to detect and block malicious bots from using the chat.

Finally, we have created and implemented an effective UI/UX design for the sales assistant to provide a smooth experience for potential clients. To make the conversation more natural and engaging, the solution responds word-by-word in real time.

Value delivered by Sparknet: improving client experience and increasing engagement

We have developed a sales assistant powered by OpenAI API and implemented it on the client’s website. With this solution, we helped the client benefit in several ways:

  • Efficiently integrated the solutions with the client’s website;
  • Improved customer experience and engagement with quick and accurate responses to inquiries, which leads to increased sales;
  • Optimized expenses by setting up effective limits on inquiries;
  • Ensure that sensitive data remains secure and the sales assistant is protected against malicious activity by implementing robust firewalls.