Senior ML Engineer
EBC Technologies
Lucknow, India2 months ago
84 views42 saves15 applies
Prepare for this role
Benefits
Remote Work
Job Type
full time
Description
Senior ML Engineer
Role Overview
You will lead the creation and productionization of our AI-driven search pipeline — from building vector indexes and deploying RAG-based systems to designing scalable APIs. You’ll work closely with our engineering team to ingest structured legal data, vectorize it, and ensure seamless integration with our user-facing web application. This role requires both deep technical expertise, a product-focused mindset and an enthusiasm to learn new techniques in the fast changing AI landscape.
Key Responsibilities
1. AI Based Search Development & Optimization
- Design and build AI-powered search models that improve retrieval and ranking of legal documents.
- Implement retrieval-augmented generation (RAG) workflows using pre-trained LLMs (e.g., OpenAI GPT-4).
- Fine-tune LLMs for legal use cases where necessary (experience with custom LLM training is a strong plus).
- Improve search quality through relevance testing, feedback loops, and query understanding.
- Research and implement any new techniques for improving search result relevancy.
2. Data Processing & Vector Indexing
- Build pipelines to ingest, chunk, and vectorize legal texts (case law, statutes, etc.).
- Create and maintain indexes in Vector Databases, supporting fast and relevant results.
- Maintain an evolving legal search index by ingesting new documents on a weekly basis.
3. Model Deployment & API Development
- Deploy ML models into production using Azure cloud infrastructure.
- Develop REST APIs (with FastAPI or Flask) to expose model functionality to the application layer.
- Monitor and optimize latency, scalability, and reliability of deployed solutions.
4. Collaboration & Product Integration
- Work closely with product managers and full-stack engineers to ship ML-backed features.
- Participate in design reviews and own technical decisions around AI architecture.
- Track and improve system performance using user feedback, telemetry, and experimentation.
Tech Stack & Tools
- ML/NLP: Python, PyTorch/TensorFlow, Hugging Face, Azure OpenAI APIs
- Vector Search: Azure AI Search (primary), experience with FAISS, Pinecone or Elasticsearch a plus
- Deployment: Azure (App Services, Azure Functions, Blob Storage, Key Vault)
- Data Processing: Pandas, NumPy, spaCy, NLTK
- APIs: REST APIs built with FastAPI or Flask
Required Skills & Experience
- 5+ years of experience in machine learning, NLP, or AI-based search systems.
- Strong knowledge of vector search, document embeddings, and retrieval techniques.
- Experience building and scaling RAG pipelines with LLMs.
- Proficiency with Azure AI Search for document indexing and search optimization.
- Demonstrated ability to deploy models to production and build robust APIs.
- Familiarity with search ranking algorithms (BM25, hybrid search, learning-to-rank).
- Experience working with document-heavy datasets in legal, academic, or enterprise domains.
- Experience with fine tuning models and creation of datasets used in fine tuning.
- On-site position for Lucknow, India.
Nice to Have
- Background in legal tech, contract analysis, or legal document retrieval.
- Exposure to open-source search frameworks like Elasticsearch or OpenSearch.
- Knowledge of observability, logging, and system performance profiling.
This job is found at InterviewStack.io
Skills
flaskragllmsopenaillmvector databasesazurerest apisfastapiscalabilitynlppythonpytorchtensorflowapiselasticsearchvaultpandasnumpymachine learningembeddingsalgorithmsobservabilitymodel deploymentfine tuningexperimentationapi development
About EBC Technologies
EBC Technologies is the software development division of EBC Publishing Pvt. Ltd., creating technological platforms for legal research and access to legal materials, including the leading legal research tool SCC Online.
legal tech, software developmentWebsite