Senior Data Engineer

Year    Pune, Maharashtra, India

Job Description


Passionate people create exceptional thingsDid you know that the solutions we develop are a key part of most industries? Electronics, medical research, renewable energy, food production, infrastructure and many more.We\xc2\xb4re everywhere! Working with us means working with the latest technologies and groundbreaking, sustainable innovations. With our inclusive and caring environment, you get the support and inspiration you need to grow.Here, your ideas are embraced, and you never stop learning. Interested in being part of our team?Join us on our journey for a better tomorrow.The RoleData Engineer (Part of the Data Domain)
Did you know that Atlas Copco is the largest Air Compressor manufacturer in the world with its compressors being used in industries ranging from hospitals to offshore oil drills? Are you looking to be part of an organization which believes in investing in its people and contributing towards their organic growth? Would you be interested to be part of the organization which is tasked with establishing, consolidating and unifying data and analytics services across the business area of Compressor Technique within Atlas Copco? Are you an experienced data engineer who would like to use their experience to build and maintain enterprise-production-grade data pipelines, considering business requirements and platform standards? This might be the perfect opportunity for you to make a difference.
Who are we?
The Data Domain is responsible for establishing, consolidating, and unifying data and analytics services across the business area of Compressor Technique within Atlas Copco. We strive to become the business partner for trusted, transparent, and robust enterprise data to enable data driven decision making.You would be a part of Data Analytics Team of Global Engineering Center (GECIA) of Atlas Copco India Ltd and supporting CTIS Data Domain team from our Hinjewadi location in Pune, India.What are we looking for?
We are looking for experienced Azure Data Engineers to build and maintain enterprise , production-grade data pipelines, considering business requirements and data platform standards.
Examples of technologies you will be working with: Azure Data Lake Storage, Delta Lake, Azure Data Factory, Databricks, Azure SQL, Azure Dev Ops.
As Azure Data Engineer you work in close collaboration with the data & analytics platform architect and platform owner, product owners, data modelers, colleague data engineers and data teams in the business.
Key responsibilities and accountabilities

  • Build, configure, deploy, and support a production-grade, scalable and secure data platform \xe2\x80\xa2 On top of this platform, you will build and support long-term, production-grade data pipelines that ingest, store, transform, process, and expose data from producer to consumer, based on business requirements \xe2\x80\xa2 You develop data pipelines using a code-first approach in line with the platform standards and practices \xe2\x80\xa2 You translate functional requirements into a technical design \xe2\x80\xa2 You provide and maintain technical documentation
  • You will be required to train and handover common data engineering related maintenance and monitoring activities to the Data Operations & Quality Team \xe2\x80\xa2 You provide 2nd and 3rd level support in a DevOps operational mode or when required (very occasionally outside of office hours)
  • You share technology and platform expertise with colleague data engineers, product owners and other people in the organization
What you can expect from us?What we offer
  • Amazing work life balance with Flexible working hours during work from home
  • Currently following Flexible office and home working policies
  • A beautiful and modern office space including modern tools at your disposal
  • A chance to become part of a global, innovative company, supporting sustainable productivity.
  • A friendly culture with immense professional and personal development, education, and opportunities for career growth
  • Free access to LinkedIn Learning and Learning link and many other internal and external trainings
  • Friendly and open culture of Swedish company
What we expect of you?Important areas of ExpertiseSkills & Experience:The ideal candidate will have a good blend of business and technical skills. Specific requirements for this position include: General skills: \xe2\x80\xa2 You have a bachelor\'s or master\'s degree in computer science, engineering, or equivalent by experience \xe2\x80\xa2 The ideal candidate has strong and demonstrable hands-on experience with data engineering on cloud-based data platforms using Databricks (Spark), preferably based on MS Azure technology: Azure Storage, Azure SQL database, Azure data factory, Azure Databricks \xe2\x80\xa2 Good coding skills (Python, SQL, or Scala) \xe2\x80\xa2 Experience with following concepts or technologies is considered a plus: o Data Lake Storage, SQL, Hive, Presto, \xe2\x80\xa6 o Databricks, Spark, Delta Lake, Hadoop, HDInsights, Cloudera, Hortonworks, MapR, \xe2\x80\xa6 o Azure Functions, Azure Synapse, Azure Analysis Services, Power BI o Python, SQL, Scala, Java, C#, \xe2\x80\xa6 o Azure AD, Ranger, \xe2\x80\xa6 o Docker, Kubernetes, \xe2\x80\xa6 o Azure, AWS, \xe2\x80\xa6 o Kafka, StreamSets, REST, \xe2\x80\xa6
Important areas of Expertise: \xe2\x80\xa2 Storage: Best of breed (Cloud) storage solutions, both for unstructured and structured data \xe2\x80\xa2 Ingestion: Streaming and batch ingestion from source systems both in the cloud and on-premises, private and public \xe2\x80\xa2 Transformation: Code-first approach using Spark (Databricks) \xe2\x80\xa2 Analytic engines: Deploy, configure, and operationalize analytics engines and its clustered infrastructure \xe2\x80\xa2 Exposure/Integration: Expose data based on consumption use-cases like data science, self-service analytics, business intelligence and operational APIs for process integration
  • Data Platform: Health, logging, monitoring, debugging, automation
Competences:
  • You have a passion for innovation and technologies, combined with strong technical and analytical skills.
  • You are customer oriented, enthusiastic, and professional
  • You have a \xe2\x80\x9ccan-do\xe2\x80\x9d mindset, \xe2\x80\x9chands-on\xe2\x80\x9d approach and are decisive. You are not afraid of making errors and are willing to learn by doing
  • You are a strong communicator with excellent collaboration skills and are customer focused
  • You have self-drive and passion \xe2\x80\xa2 You are flexible and prepared to work outside of business hours if required to meet a deadline.
  • You have a proactive attitude and always strive for continuous improvement
  • You are able to cooperate with different levels in the organization, with different people and cultures
  • You can maintain good relations with external parties
  • You are stress resistant.
  • You are result oriented and quality focused on terms of processes.
City
PuneLast Day to Apply21/08/2023Diverse by nature and inclusive by choice
Bright ideas come from all of us. The more unique perspectives we embrace, the more innovative we are. Together we build a culture where difference is valued and we share a deep sense of purpose and belonging.

Atlas Copco

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3311213
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Pune, Maharashtra, India
  • Education
    Not mentioned
  • Experience
    Year