Sr. Data Engineer (java/python & Spark, 4+yrs )

Year    Bangalore, Karnataka, India

Job Description


Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose - to uplift everyone, everywhere by being the best way to pay and be paid.Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.Team SummaryThe Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing fraud losses.What a Sr Data Engineer does at Visa:The Sr Data Engineer will be a member of RSS team in Asia Pacific. The position will be based in Visa\'s Bangalore office.The individual will be accountable for supporting and driving the design, development and implementation of analytics-driven strategies as well as high-impact solutions for Visa clients. He/she will bring in deep expertise from banking and payments with a strong background in data pipelines to solve complex problems and unlock business value.ResponsibilitiesExperience on developing, maintaining and supporting big data ETL pipelines (Hadoop, Hive, Spark)Responsible for the implementation and test of scalable distributed ensuring security, timeliness and quality of data.Experience supporting production systemsWork closely with other engineers and peers to design and develop ETL pipelinesWork with product managers in understanding and clarifying on the requirementsDemonstrate inclination towards continuous learning and professional development.Proven track record of quickly acquiring new skills and knowledge in a fast-paced environment.This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.QualificationsBasic Qualifications

  • 2 or more years of work experience with a Bachelor\'s Degree or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)
Preferred Qualifications
  • 5+ yrs. work experience with a Bachelor\'s degree or 4+ Master\'s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.
  • Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)
  • Experience in writing Spark and Hive code to process large data sets in Hadoop environments
  • Strong experience with SQL for extracting, aggregating, and processing big data using Hadoop
  • Development experience in one or more of the following: Scala, Python or Java.
  • Basic experience with Unix/Shell or Python scripting
  • Exposure to Scheduling tools like Airflow and Control - M will be a plus
  • Experience using VCS like Git
  • Basic understanding of RDBMs viz, MS SQL, DB2, Oracle, etc for data retrieval
  • Understanding of Kafka, Apache Hudi is a plus.
Additional InformationVisa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3448408
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year