Job Description

Position: Lead Data Engineer

Experience: 10+ Years Location: Bengaluru, India

Mandatory Required Qualification

• Strong proficiency in cloud-based data platforms such as AWS, Azure, or Google Cloud Platform
• Strong programming skills like Python, Java, Scala etc.
• Experience in DevOps and CI/CD implementation
• Knowledge of data warehousing and ETL processes
• Excellent Communication Skills In This Role, You Will
• Possess analytical skills to evaluate, understand and interpret credit bureau data from the three national credit bureau agencies
• Writes specifications to capture specific consumer behaviors from data assets o Must be able to communicate ideas and analysis results effectively both verbally and in writing to both internal and external clients
• Good knowledge in the DevOps pipelines and implementation of CI/CD pipelines.
• Responsible for executing analytical projects, leading project development for data analysis and decision support tools
• Supervising the data engineering team to provide robust data/analytics platforms to the entire organization
• Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Designing and supervising strategic internal data tools
• Designs data integrations and data quality framework.
• Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
• Reviewing code before delivery
• Exploring new data sources to provide additional data to power business strategy decisions o Build, scale and maintain data pipelines to process billions of daily events into our Hadoop and RDBMS data warehouses
• Stay up-to-date with emerging technologies and industry trends in data engineering and make recommendations for adoption. Skills & Knowledge
• Bachelors or Masters degree in Computer Science, Data Science, or a related field.
• 10+ years of experience in data engineering Strong understanding of data modeling, data warehousing, and ETL processes/data integration [One of the Snowflake, Databricks or Spark].
• Proficiency in programming languages such as Python, Java, or Scala, and experience with data engineering tools such as Apache Spark, Hadoop, and Kafka.
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.
• Excellent communication and collaboration skills with the ability to work with cross functional teams and stakeholders.
• Experience programming in SAS, UNIX, Perl, Python, C++, SQL, Excel VB, and other languages
• Designing and building statistical analysis models, machine learning models, other analytical modeling using these technologies on large data sets
• Would require working with business users, understanding requirements, and training the junior team members.
• Good team leading capabilities.
• Experience with Informatica PowerCenter desired
• Hands-on experience working in an Agile setting.
• Is self-driven, naturally curious, and able to adapt to a fast-paced work environment.
• Can articulate, create, and maintain technical and non-technical documentation.
• Public cloud certifications are desired

Job Type: Full-time

Pay: Up to ?3,000,000.00 per year

Work Location: Remote