Open-Source LLM/SLM Specialist (India - Remote) India Posted 2026-07-16 š Job Title: Open-Source LLM/SLM Specialistš Location: India - Remoteš Employment type: Full-timeš Environment: Consulting About the Role We are searching on behalf of our client for this role. This position is not with OVI.This role focuses on developing, fine-tuning, evaluating, and deploying open-source Large Language Models (LLMs) and Small Language Models (SLMs) for enterprise AI applications. The ideal candidate will have hands-on experience building production-ready AI solutions using open-source models, with a strong understanding of private and on-premise deployments. Key Responsibilities Fine-tune and optimize open-source LLMs and SLMs for enterprise use cases. Design and execute model evaluation, benchmarking, and performance testing. Deploy and manage models across cloud, private, or on-premise environments. Build inference pipelines and optimize models for performance and scalability. Collaborate with AI engineers and data teams to integrate models into production applications. Ensure model security, monitoring, and operational reliability. Core Requirements 3+ years of experience in AI/ML Engineering or related software engineering roles. Hands-on experience training and fine-tuning open-source LLMs or SLMs. Experience with model evaluation, optimization, and deployment. Proficiency in Python and modern AI/ML development frameworks. Understanding of model serving, inference, and production deployment best practices. Familiarity with GPU-based environments and scalable AI infrastructure. AI-Focused Experience Experience working with open-source models such as Llama, Mistral, Qwen, Gemma, or similar. Hands-on experience deploying models in private, secure, or on-premise environments. Familiarity with Hugging Face, vLLM, Ollama, or similar open-source AI ecosystems. Exposure to model quantization, optimization, or inference acceleration is preferred. Understanding of enterprise AI security and responsible AI practices What's Offered Opportunity to work in a fully integrated global delivery function. Collaborative work environment with US-based consultants and product leads. Remote work flexibility. Ideal Candidate The ideal candidate is a builder who ships, not just experiments, and takes strong ownership and accountability for outcomes. You should be able to think in systems, not just in code, and be pragmatic about AI capabilities and trade-offs. A passion for maintainability and long-term code health, along with the ability to collaborate across time zones and disciplines, is essential. When you apply to this role, AI may be used to help analyse and format your information so the hiring team can review it more easily. Frequently asked questionsHow do I apply for the Open-Source LLM/SLM Specialist (India - Remote) role?You can apply directly on this page ā submit your CV and contact details through the application form, no account required.