Building enterprise wide Conversational BI chatbot that provides data & analytics information and insights on business questions.
Design end to end Conversational AI architecture optimizing for cost, ensuring chatbot performance, accuracy, security, user experience and minimizing latency.
Design AI agents (for Text to SQL, Table selection, column pruning, intent agent etc ), leverage the right LLMs and Gen AI frameworks to ensure scalability, performance, and alignment with the companys tech stack.
xefxbbxbfxefxbbxbfxefxbbxbfLead & mentor AI developers and data engineers to create LLM/AI applications and deploy on cloud or on-prem.
Design storage, caching and compute layers for efficient data retrieval and outputs in the AI chatbot.
Architect, deploy and optimize Retrieval-Augmented Generation (RAG) systems and work with vector databases to implement query efficiency, ensure high-quality and relevant outputs for users.
Implement Lang Chain or similar frameworks to build custom pipelines for Gen AI use cases
Develop new prompt engineering methods to get desired outputs on conversational or other AI apps
Research and integrate the latest advancements in generative Al technologies.
xefxbbxbfxefxbbxbfxefxbbxbfExperiment with fine-tuning and adapting large language models (like GPT, BERT) for new, innovative use cases.
Able to filter through ambiguity present in business problems & come up with a well-structured methodology
Must have:
3+ years of experience in data science/computer science/AI related roles
Bachelors degree or higher in computer science, data science, engineering, or a related field
Experience in using major language models like GPT, BERT, Google Gemini, Llama, Claude etc. for innovative use cases
Proficient in Python and has experience with cloud-based platforms (AWS, Azure, GCP etc.)
xefxbbxbfxefxbbxbfExperience with GenAI tools like Open AI, Langchain, vector DB, RAG pipelines and prompt engineering.
Preferable experience in fine tuning open source models (LLaMA, BERT, Hugging Face etc.)
Strong analytical & problem-solving skills
Strong verbal and written communication skills
Strong business acumen & demonstrated aptitude for analytics that incite action
Knowledge or experience with Langchain, LlamaIndex or DSPy and associated libraries.
Nice to have: Experience with large enterprise data on hybrid data storage environments with multiple cloud & on-prem storage systems.
Nice to have: Familiarity with Kubernetes, ability to build pipelines, be familiar with containerizing and creating API endpoints.