Job Description

:Role & ResponsibilitiesThe Senior Data Engineer will be responsible forxc2xb7 Create and maintain optimal data pipeline architecture; assemble large, complex data sets that meet functional / non-functional requirements.xc2xb7 Design the right schema to support the functional requirement and consumption pattern.xc2xb7 Design and build production data pipelines from ingestion to consumption.xc2xb7 Build the necessary datamarts, data warehouse required for optimal extraction, transformation, and loading of data from a wide variety of data sources.xc2xb7 Create necessary preprocessing and postprocessing for various forms of data for training/ retraining and inference ingestions as requiredxc2xb7 Create data visualization and business intelligence tools for stakeholders and data scientists for necessary business/ solution insightsxc2xb7 Identify, design, and implement internal process improvements: automating manual data processes, optimizing data delivery, etc.xc2xb7 Ensure our data is separated and secure across national boundaries through multiple data centers and AWS regions.Technical Skill Setxc2xb7 Hands on experience in Informatica PowerCenter/IICS as an ETL toolxc2xb7 Experience with AWS cloud services: EC2, EMR, RDS, Redshift, S3, Athena and familiarity with various log formats from AWS.xc2xb7 Experience in AWS Glue ETL, AWS Crawler, AWS Lambda, Glue Data Catalog, AWS Glue Studio.xc2xb7 Hands on experience with python programming, spark, shell scriptingxc2xb7 Knowledge of Database Concepts - Indexing, Partitioning is must.xc2xb7 Knowledge of Data warehousing - Normalization, Denormalization, Star/Snow-flake schemas.xc2xb7 Good Hands -on the table's creations, DDL, DML and TCLxc2xb7 Experience with big data tools: Hadoop, Spark, Kafka, etc.xc2xb7 Experience with data pipeline and workflow management tools: Airflow, Luigi etc.QualificationsGraduate
Schedule: Full-time
Req: 009BWK

Schneider Electric