Jio-bp

Jio-bp (Reliance BP Mobility Limited) is a joint venture between Reliance Industries Limited (RIL) and bp, committed to transforming the mobility and energy landscape in India. Jio-bp delivers world-class fuels, mobility solutions, and customer experiences while advancing sustainability and digital innovation. As part of its digital transformation journey, Jio-bp is establishing an AI Center of Excellence (AI CoE) to drive data-led decision-making, innovation, and operational excellence across business functions.Role OverviewThe Data Engineering Lead will build and operate the enterprise lakehouse and data pipelines on Azure Databricks that power analytics, AI/ML, and GenAI. This is a hands-on lead role with small team management, responsible for delivery outcomes, engineering standards, and reliable production operations.Key ResponsibilitiesLead a small Data Engineering team (and coordinate partner resources where applicable): planning, tasking, mentoring, code reviews, and delivery governance. Design, build, and run scalable ETL/ELT pipelines on Azure Databricks (Spark/Delta) for batch and near real-time processing. Deliver curated AI-ready datasets with data contracts: quality checks, refresh cadence, SLAs, and documentation. Implement governance & security by design: RBAC, secrets (Key Vault), auditability/lineage, catalog/metadata, and Dev/UAT/Prod controls (Unity Catalog or equivalent). Set up orchestration and automation using ADF and/or Databricks Workflows with retries, backfills, and failure handling. Establish CI/CD and engineering standards using Azure DevOps/GitHub Actions: version control, testing, release gates, and rollback. Build operability: monitoring, alerting, runbooks, and incident response for critical pipelines. Enable AI/GenAI consumption: training/inference feeds, feature-ready data, and document/metadata pipelines for RAG/embeddings refresh. Partner with AI Architects, MLOps, Cloud, Security/IRM, and Business SPOCs to manage dependencies and ensure platform readiness. Must-Have Skills & ExperienceB.Tech. in a relevant field (CS/IT/ECE or similar) or equivalent. 8–12 years in Data Engineering with 3+ years leading delivery and owning production pipelines. Strong hands-on skills in Python, SQL, PySpark/Spark and data modeling. Strong experience with Azure Databricks, Delta Lake, Azure Data Factory (Synapse a plus). Experience with streaming/event and integration patterns (Event Hub/Kafka, APIs). Strong understanding of lakehouse architecture, performance tuning, and cost optimization. Experience implementing governed enterprise data platforms: RBAC, audit/lineage, catalog/metadata, secure access patterns. Strong communication and stakeholder management; ability to lead a small team and drive delivery across teams/partners. Familiarity of GCP or AWS is a Plus.Why Join Jio-bp AI CoEOpportunity to build and shape an enterprise-grade AI/GenAI platform on Azure Databricks from the ground up. Work at the intersection of energy, mobility, and digital innovation with high-visibility, high-impact programs. Collaborate with cross-functional teams and contribute to RIL’s broader AI transformation agenda. Be a core builder of the AI CoE foundation, driving measurable business value across Jio-bp operations.

Job Details

Skills Required

More Details

Easy Apply