Jio-bp

Jio-bp (Reliance BP Mobility Limited) is a joint venture between Reliance Industries Limited (RIL) and bp, committed to transforming the mobility and energy landscape in India. Jio-bp delivers world-class fuels, mobility solutions, and customer experiences while advancing sustainability and digital innovation. As part of its digital transformation journey, Jio-bp is establishing an AI Center of Excellence (AI CoE) to drive data-led decision-making, innovation, and operational excellence across business functions.Role OverviewThe Senior Data Engineer will build and run reliable, governed, and scalable data pipelines and curated datasets that power analytics, AI/ML, and GenAI workloads. This is a hands-on role working closely with Data Engineering Lead, AI Architects, MLOps, Cloud, Security/IRM, and Data Science teams to deliver production-grade data products.Key ResponsibilitiesBuild and maintain ETL/ELT pipelines on Azure Databricks (PySpark/SQL, Delta Lake) for batch and near real-time processing. Implement ingestion from multiple sources using ADF, APIs, and event-driven patterns (Event Hub/Kafka where applicable). Deliver curated AI-ready datasets with quality checks, refresh SLAs, documentation, and performance tuning. Support AI/ML and GenAI readiness: model training/inference feeds, feature-ready datasets, and text/document/metadata pipelines for RAG/embeddings refresh. Implement pipeline monitoring, alerting, and failure handling (retries, backfills), and contribute to runbooks/operational readiness. Follow security and governance by design: RBAC, secrets management, auditability/lineage, and Dev/UAT/Prod discipline (Unity Catalog/Purview-aligned patterns). Contribute to engineering standards: code reviews, reusable components, documentation, and CI/CD automation with Azure DevOps/GitHub Actions.Must-Have Skills & ExperienceB.Tech. in a relevant field (CS/IT/ECE or similar) or equivalent. 4–8 years in Data Engineering with strong Python and SQL skills. Hands-on experience with Azure Databricks, PySpark/Spark, Delta Lake, and Azure Data Factory. Working knowledge of streaming/event and orchestration patterns (Event Hub/Kafka, ADF/Databricks Workflows; Airflow is a plus). Strong understanding of data modeling, lakehouse concepts, performance optimization, and cost-aware pipeline design. Familiarity with Git and CI/CD, and basic containerization concepts (Docker) is a plus. Good understanding of data governance and security basics: RBAC, access controls, metadata/lineage, and compliance practices. Familiarity of GCP or AWS is a Plus.Why Join Jio-bp AI CoEOpportunity to build and shape an enterprise-grade AI/GenAI platform on Azure Databricks from the ground up. Work at the intersection of energy, mobility, and digital innovation with high-visibility, high-impact programs. Collaborate with cross-functional teams and contribute to RIL’s broader AI transformation agenda. Be a core builder of the AI CoE foundation, driving measurable business value across Jio-bp operations.

Job Details

Skills Required

More Details

Easy Apply