Staff Data Engineer (java/python & Spark 8+ Years)

Year    Bangalore, Karnataka, India

Job Description


Company DescriptionVisa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose - to uplift everyone, everywhere by being the best way to pay and be paid.Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.Team SummaryThe Risk Solution Services (RSS) team, part of the Acceptance Risk organization, includes data engineers who develop and support data applications for generating reports and insights for Risk Consultants working with global clients. These insights help tune fraud detection rules, maximizing automated acceptance while minimizing fraud losses.What a Staff Data Engineer does at Visa:The Staff Data Engineer will be a member of RSS team in Asia Pacific. The position will be based in Visa\'s Bangalore office.You will be responsible for mentoring top engineering talent, keeping the team highly engaged and motivated while delivering exceptional results. Your ability to work across functions and teams will allow you to drive results and foster the right culture and environment to achieve Engineering Excellence and Innovation. You will be responsible for working with product development, quality engineering, security engineering, enterprise operations and other internal and external technology partners to deliver products for business integration & enablement.ResponsibilitiesStrong technology and leadership background building and managing enterprise scale Data Engineering pipelines (Hadoop, Hive, Spark)Should posses a solid understanding of data engineering principles and best practicesResponsible for the design, implementation and test of scalable distributed systems that take advantage of technology to allow standardization, security, timeliness and quality of data.Lead code reviews, ensuring adherence to coding standards, and promoting clean, efficient code within the team.Experience creating/supporting production software/systems and a proven track record of identifying and resolving performance bottlenecks for production systems.Work closely with senior engineers to develop the best technical design and approach for new product development.Work with product managers in developing a strategy and road map to provide compelling capabilities that helps them succeed in their business goals.Identify opportunities for further enhancements and refinements to standards and processes.This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.QualificationsBasic Qualifications

  • 5 or more years of relevant work experience with a Bachelors Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD
Preferred Qualifications
  • 8+ yrs. work experience with a Bachelor\'s degree or 7+ Master\'s or Advanced degree in an analytical field such as computer science, statistics, finance, economics or relevant area.
  • Working knowledge of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, etc.)
  • Strong experience in writing and optimizing spark code and Hive code to process large data sets in Hadoop environments
  • Experience with Advanced SQL for extracting, aggregating, and processing big data using Hadoop
  • Strong Development experience in one or more of the following: Scala, Python or Java.
  • Experience with Linux systems with Unix/Shell or Python scripting and exposure to Scheduling tools like Airflow and Control - M.
  • Experience with Continuous Integration and Automated Test tools such as Jenkins, Artifactory, Git, Selenium, Chef desirable
  • Familiarity with RDBMs viz, MS SQL, DB2, Oracle, etc for data retrieval
  • Knowledge on Streaming technologies like Kafka, Spark streaming, etc with Apache Hudi will be a plus
  • Experience in managing and operating AWS (other cloud) services including EC2, S3, SageMaker etc.
  • Exposure to public cloud equivalents, and ecosystem shall be a plus.
  • Knowledge on Visualization Tools like Tableau, Power BI, is a plus.
Additional InformationVisa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Visa

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3445823
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year