Data Engineer

Year    Pune, Maharashtra, India

Job Description


Job Family Group: IT&S Group:Role SynopsisDigital Customers & Markets (DCM) works with customers & products (C&P), gas & low carbon energy (G&LCE), trading & shipping (T&S) and regions, cities & solutions (RC&S), and focus on enabling and delivering amazing customer experiences that generate value for bp in current and new markets.DCM Intelligent operations (IO) bridges the gap between bps physical and digital worlds to release value and enable world-class operations through deployment of new and emerging digital solutions. Our SMEs and partners work closely with our business units to ensure safe, efficient, and optimized operations and great customer experiences.At DCM IO we have embarked on a very exciting journey with a pipeline of leading-edge programmes of work in the field of automation, Internet of Things (IoT) and Edge Vision to name a few. We are building platforms for the future and products focused on these technologies and more. We plan to build a Centre Of Excellence (COE) in Pune that will build and house essential digital capabilities, innovative solutions, toolsets required to deliver products for our customers thereby driving bps digital agenda.Senior Data Engineer will be part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers, product owners and Portfolio managers.Key Accountabilities

  • Architects, designs, implements and maintains reliable and scalable data infrastructure.
  • Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
  • Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring & alerting, checking in code, code review, documentation),
  • Responsible for deploying secure and well-tested software that meets privacy and compliance requirements; develops, maintains and improves CI / CD pipeline,
  • Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Design, build, deploy and maintain infrastructure as code. Containerizes server deployments.
  • Actively contributes to improve developer velocity.
  • Creating and code management of data pipelines and automation templates
  • Testing new / changes to functionalities , creating test cases
  • Designing data storage
  • Mentors others.
  • Play active role in building DCM COE
Essential Education:
  • Bachelor or masters degree in computer science, Engineering, Informatics, Information Systems or in another quantitative fields
Essential Experience and Job Requirements:Years of experience: 4 to 6 years with minimum of 3 years relevant experienceRequired Criteria
  • Deep and hands-on experience (typically 4+ years) designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
  • Development experience in one or more object-oriented programming languages (e.g. Py-spark, Python, Java, C++)
  • Experience designing and implementing large-scale distributed data pipelines on AWS/Azure cloud (preferably AWS)
  • Advanced data modeling and dimensional modeling knowledge
  • Advanced SQL knowledge
  • Deep knowledge and hands-on experience in technologies across all data lifecycle stages
  • Experience of working in relational and non-relational data bases
  • Experience using Azure DevOps , GitHub
  • Continuous learning and improvement approach
Desirable criteria
  • Strong customer management and ability to lead large organizations through influence
  • Experience of working with Azure / AWS IoT services
  • Experience of working in Energy/Utilities industry
Additional InformationKey Behaviours
  • Empathetic: Cares about our people, our community and our planet
  • Curious: Seeks to explore and excel
  • Creative: Inspires the extraordinary
  • Inclusive: Brings out the best in each other
Travel Requirement: Up to 10% travel should be expected with this roleRelocation Assistance: This role is eligible for relocation within countryRemote Type: This position is a hybrid of office/remote workingSkills: Commercial Acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms, Data visualization and interpretation, Digital Security, Extract, transform and load, Group Problem SolvingLegal Disclaimer:We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with disabilities may request a reasonable accommodation related to bps recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an accommodation related to the recruitment process, please to request accommodations.If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

BP

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3433107
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Pune, Maharashtra, India
  • Education
    Not mentioned
  • Experience
    Year