Position Name - Data EngineerLocation - BangaloreExperience Range - 3-6 YrsMandatory Requirement:
Proven ability to work independently and with a team.
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience building and optimizing \xe2\x80\x98big data\xe2\x80\x99 data pipelines, architectures, and data sets.
Job Roles and Responsibilities:
Design, build and maintain batch or real-time data pipelines in production.
Maintain and optimize the data infrastructure required for accurate extraction, transformation, and loading of data from a wide variety of data sources.
Develop ETL (extract, transform, load) processes to help extract and manipulate data from multiple sources. Automate data workflows such as data ingestion, aggregation, and ETL processing.
Prepare raw data in Data Warehouses into a consumable dataset for both technical and non-technical stakeholders. Partner with data scientists and functional leaders in sales, marketing, and product to deploy machine learning models in production.
Working knowledge of both on-premise and Cloud-based solutions (e.g. AWS, Azure, GCP).
Strong proficiency in creating data pipelines, data modeling, and workflow management tools (e.g., Airflow, Azkaban).
Qualification and Experience:
Experience of 3-6 years of experience
Skillset Summary: ETL and Data Modelling, developing databases, and provisioning of data for all organizational data, analytics, and insights initiatives. Managing the day-to-day data pipeline, load, and provisioning of data.