Data Engineer Chennai

Year    Chennai, Tamil Nadu, India

Job Description


Job Title: Data EngineerWe are looking for a hands-on Data Engineer who is passionate about solving business problems through innovation and engineering practices. As a Data Engineer, the candidate will leverage deep technical knowledge and will apply knowledge of data architecture standards, data warehousing, data structures, and business intelligence to drive the creation of high-quality data products for data driven decision making.Required Qualifications6+ Years of relevant experience of implementing data-intensive solutions using agile methodologies.Code contributing member of Agile teams, working to deliver sprint goals.Write clean, efficient, and maintainable code that meets the highest standards of quality.Very strong in coding Python/Pyspark, UNIX shell scriptingExperience in cloud native technologies and patternsAbility to automate and streamline the build, test and deployment of data pipelinesTechnical Skills (Must Have)

  • ETL: Hands on experience of building data pipelines. Proficiency in data integration platforms such as Apache Spark
Experienced in writing Pyspark code to handle large data set ,perform data transformation , familiarity with Pyspark integration with other Apache Spark component ,such as Spark SQL , Understanding of Pyspark optimization techniquesStrong proficiency in working with relational databases and using SQL for data querying, transformation, and manipulation.
  • Big Data: Exposure to xe2x80x98big dataxe2x80x99 platforms such as Hadoop, Hive or Iceberg for data storage and processing
  • Data Warehousing & Database Management: Understanding of Data Warehousing concepts, Relational (Oracle, MSSQL, MySQL) and NoSQL (MongoDB, DynamoDB) database design
  • Data Modeling & Design: Good exposure to data modeling techniques; design, optimization and maintenance of data models and data structures
  • Languages: Proficient in one or more programming languages commonly used in data engineering such as Python, PySpark, UNIX Shell scripting
  • DevOps: Exposure to concepts and enablers - CI/CD platforms, bitbucket/Github, JIRA, Jenkins, Tekton, Harness
Technical Skills (Valuable)
  • Data Quality & Controls: Exposure to data validation, cleansing, enrichment and data controls, framework libraries like Deequ
  • Federated Query: Starburst, Trino
  • Containerization: Fair understanding of containerization platforms like Docker, Kubernetes, Openshift
  • File Formats: Exposure in working on File/Table Formats such as Avro, Parquet, Iceberg, Delta
  • Schedulers: Basics of Job scheduler like Autosys, Airflow
  • Cloud: Experience in cloud native technologies and patterns (AWS, Google Cloud)
  • Nice to have: Java, for REST API development
Other skills :
  • Strong project management and organizational skills.
  • Excellent problem-solving, communication, and organizational skills.
  • Proven ability to work independently and with a team.
  • Experience in managing and implementing successful projects
  • Ability to adjust priorities quickly as circumstances dictate
  • Consistently demonstrates clear and concise written and verbal communication
Education:
  • Bachelorxe2x80x99s degree/University degree or equivalent experience
Job Family Group: TechnologyJob Family: Applications DevelopmentTime Type: Full timeCiti is an equal opportunity and affirmative action employer.Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.Citigroup Inc. and its subsidiaries ("Citixe2x80x9d) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review .View the " " poster. View the .View the .View the

Citigroup

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3559080
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Chennai, Tamil Nadu, India
  • Education
    Not mentioned
  • Experience
    Year