Senior / Lead Data Engineer

Year    Pune, Maharashtra, India

Job Description


Passionate people create exceptional thingsDid you know that the solutions we develop are a key part of most industries? Electronics, medical research, renewable energy, food production, infrastructure and many more.Wexc2xb4re everywhere! Working with us means working with the latest technologies and groundbreaking, sustainable innovations. With our inclusive and caring environment, you get the support and inspiration you need to grow.Here, your ideas are embraced, and you never stop learning. Interested in being part of our team?Join us on our journey for a better tomorrow.Your RoleAtlas Copco is the largest Air Compressor manufacturer in the world with its compressors being used in industries ranging from hospitals to offshore oil drills. Are you looking to be part of an organization which believes in investing in its people and contributing towards their organic growth? Would you be interested to be part of the organization which is tasked with establishing, consolidating and unifying data and analytics services across the business area of Compressor Technique within Atlas Copco? Are you an experienced data engineer who would like to use their experience to build and maintain enterprise-production-grade data pipelines, considering business requirements and platform standards? This might be the perfect opportunity for you to make a difference.The Data Domain is responsible for establishing, consolidating, and unifying data and analytics services across the business area of Compressor Technique within Atlas Copco. We strive to become the business partner for trusted, transparent, and robust enterprise data to enable data driven decision making.Atlas Copco is a Swedish multinational industrial company that was founded in 1873 headquartered in Nacka, Sweden.. Atlas Copco is world leader in Compressors manufacturing and It also manufactures industrial tools and equipments.We are a Engineering Service Provider company within Atlas Copco Group called Global Engineering Centre India Airpower (GECIA). In recent 5+ years, we are also focusing on Digital transformation Technologies for Data Driven Decisions, Web and Applications developments, Automations, Embedded Technology etc.Data Analytics Competence is the competence withing this Digital Technology Practice of GECIA withing GECIA having team strenght of more than 85 skilled and experienced BI engineers, Data Engineers , Data Scientist, SAP BW, SAP BODS expertise etc.Digital Technology Practice at GECIA (Global Engineering Centre, India), part of Atlas Copco, is contributing significantly to vision of the Group by focusing on developing global talent, expanding portfolio and competence on futuristic competencies, driving Innovation and achieving operational excellence to drive customer success.As a Sr. / Lead Data Engineer your mission will be to build and maintain enterprise , production-grade data pipelines, considering business requirements and data platform standards. You must have hands on experience in building ETL flows , using CI CD pipelines , using cloud technologies such as Azure Data lake, ADF, DataBricks, Visualisations tools such as Power BI. Additioanally SQL is a must. Knowledge of Python will be added advantage.Examples of technologies you will be working with: Azure Data Lake Storage, Delta Lake, Azure Data Factory, Databricks, Azure SQL, Azure Dev Ops.You would be a part of Data Analytics Team of Global Engineering Center (GECIA) of Atlas Copco India Private Ltd and supporting Industrial Tools Business Area. As a Data Engineer within our Data Anlytics Competence team, you will lead the management and organisation of data for our custom-built applications and bringing the Data Driven meaningful insights. You will be instrumental at every stage of the project lifecycle from extracting, transforming, and loading (ETL) data, to managing data pipelines and cloud infrastructure.Key responsibilities and responsibility:Should have strong 5-10 years' experience on ETL and ELT.Expert knowledge of SQL with capabilities to perform tune complex SQL queries.Mandatory Skill: Azure Data Bricks, SQL, Pyspark.Should have strong hands-on experience building data pipelines.Design and implement effective database solution and data models to store and retrieve data.Provide guidance and advice on data and solution to stakeholders.Hands-on experience on Agile methodology, Nice to have Jira exposure.Effective problem solving and analytical skill, ability to manage multiple projects.Experience with any data virtualisation platform.Be able to build and maintain ETL/ELT data pipelines independently.Be able to assemble large, complex data sets from multiple data sources that meet business requirements.And be able to do this whilst being the sole data engineering resource as part of a larger project team.Be able to create documentation on the data pipelines and data models developed.Design/Build/Test/Deploy/Operate/Support/ChangeThe ideal candidate has a degree in Computer Science, Information Technology, Business economics or equal through experience.Good knowledge on BI development principles, time intelligence functions, dimensional modelling and data visualization is required.Mentor and guide Junior team membersKnowledge minimum 1- 2 years' experience with professional BI development & data visualization is preferred.You are experienced in data modelling.Able to lead small projects in data engineering space.You have a good understanding of data warehousing and relational database concepts & technologies.To succeed, you will needCompetences

  • You are a team player and able to motivate people.
  • You are a customer focused, flexible, enthusiastic.
  • You have good leadership skills.
  • You have very strong analytical skills.
  • Understanding of manufacturing and Engineering process & flows is seen as added value.
  • You have a strong drive, and you take initiative.
  • You are flexible, eager to learn new things and able to adapt in a fast-changing world.
  • You are result oriented and quality focused, both in terms of deliveries and processes.
  • You work systematically and accurately with a strong focus on user experience.
Stakeholder management:
  • You can discuss with stakeholders about their requirements and clearly communicate back your understanding of the requirements.
  • You can work with the stakeholders to understand the big picture and work towards it
  • Educate users regarding the functionalities provided and train them in using the visualization tool efficiently.
  • Work with team members and other users from the organization at different levels for performance improvement and suggestions
Must have:
  • Azure Data Bricks, Azure Data factory, SQL, Python, PySpark, ETL
  • Excellent knowledge (oral and written) of English is required.
Nice to have.
  • Knowledge/experience of Microsoft Azure applications
  • Experience of a Source Control system such as Git or SVN
  • Knowledge of Power BI, Azure services, Python.
  • Knowledge of Azure Data Lake Storage
  • Knowledge of Databricks Unity Catalog
  • Knowledge of Azure DevOps
Education
  • Any Graduate (B.E / B.Tech/MCA/MTech/BSc/MSc/MCs) in Engineering with 5-10 years of experience in Data Engineering field , projects and tools.
Knowledge
  • You have strong technical knowledge, specific knowledge of the Data Analysis tools, methodologies, reporting etc.
  • Good analytical skills: You feel comfortable working with numbers/data, e.g. collecting and analysing trend graphs, combining the info with insights from ERP and previous site visits, xe2x80xa6 to come to a sound conclusion.
  • You are fluent in English: both written and spoken.
  • Working Knowledge of Agile scrum ceremonies.
  • Knowledge of industry paradigms such as Data Fabric and Data Mesh will be nice to haves for both roles.
Personality requirements
  • You like open communication and enjoy working with different cultures You are decisive (not afraid of making errors and willing to learn by doing)
  • Open minded; expect the unexpected stay sceptical when viewing at the data and info)
  • Not afraid to approach other stakeholders (customer centre specialists, local engineering, or technical support specialists)
  • You work with a structured approach when collecting info and data, but also when closing the feedback loop to further increase your learning.
In return, we offer youWhat we offer
  • Flexible working hours.
  • Flexible office and home working policies.
  • International travel opportunities.
  • A modern infrastructure providing you with the latest tools and technologies at your disposal.
  • A challenging environment which contributes to your constant learning and professional growth.
  • To be part of the data competence team which is constantly growing.
  • Depending on the country you are enrolled in group healthcare insurance plans covering your medical needs.
  • A chance to become part of a global, innovative company, supporting sustainable productivity.
  • You get the opportunity to bring revolutionary ideas fostering innovation and execute qualified ideas.
  • A friendly culture with immense professional and personal development, education, and opportunities for career growth.
  • Free access to LinkedIn Learning and many other internal and external trainings.
  • Atlas Copco offers trainings on a regular basis to acquire new skills.
  • You get the opportunity to make the world a better place through our sustainable goals and by contributing and being part of our Water for all projects.
  • Friendly and open culture of Swedish company. Very high visibility in the organization with "No door" culture, you can always talk to anyone in the organization.
  • Free Canteen & Transport facility.
xe2x80x8bCity
PuneLast Day to Apply19/02/2025Diverse by nature and inclusive by choice
Bright ideas come from all of us. The more unique perspectives we embrace, the more innovative we are. Together we build a culture where difference is valued and we share a deep sense of purpose and belonging.

Atlas Copco

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Job Detail

  • Job Id
    JD3602629
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Pune, Maharashtra, India
  • Education
    Not mentioned
  • Experience
    Year