Data Engineer Python, Pyspark

Year    HR, IN, India

Job Description

Description
---------------


About Gartner IT:

Join a world-class team of skilled engineers who build creative digital solutions to support our colleagues and clients. We make a broad organizational impact by delivering cutting-edge technology solutions that power Gartner. Gartner IT values its culture of nonstop innovation, an outcome-driven approach to success, and the notion that great ideas can come from anyone on the team.


About the Role:

Gartner is looking for passionate and motivated Data Engineers who are excited to foray into new technologies and help build / maintain data driven components for realizing business needs. This role is in Gartner Digital Product Technologies (DPT). DPT Data Engineering teams are high velocity agile teams responsible for developing and maintaining components crucial to customer-facing channels, data science teams, and reporting & analysis. These components include but are not limited to Spark jobs, REST APIs, AI/ML model training & inference, devops pipelines, data transformation & quality pipelines, data lake & data catalogs, data streams etc.


What you will do:

• Build new ETL pipelines using AWS EMR, Spark, python.
• Responsible to review and analysis of business requirements and design technical mapping document
• Collaborate on Data Lake/warehouse architecture and technical design discussions.
• Maintain Service Levels and department goals for problem resolution.
• Should be able to interact and coordinate well with other developers / teams to resolve operational issues.
• Should be self-motivated and a fast learner to ramp up quickly with a fair amount of help from team members.
• Must be able to estimate development tasks with high accuracy and deliver on time with high quality while following coding guidelines and best practices.
• Identify systemic operational issues and resolve them.
• Design, build and automate the deployment of data pipelines and applications to support data scientists and researchers with their reporting and data requirements.
• Work with administrative resources and support provisioning, monitoring, configuration, and maintenance of AWS tools.
• Promote the integration of new cloud technologies and continuously evaluate new tools that will improve the organization's capabilities while leading to lower total cost of operation.
• Support automation efforts across the data analytics team utilizing Infrastructure as Code (IaC) using Terraform, Configuration Management, and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Jenkins.

What you will need:

2- 4 years of post-college experience in data engineering, API development or related fields


Must have:

• Demonstrated experience in data engineering.
• Skills to transform data, prepare it for analysis, and analyze it - including structured and unstructured data.
• Proficiency with SQL and its variation among popular databases
• Understanding of the modern relational databases
• Skilled at optimizing large, complicated SQL statements.
• Demonstrated experience or working knowledge of cloud platforms (AWS, Azure, GCP, etc.)
• Experience with languages such as Python, Java, SQL
• Experience with tools such as Apache Spark, Databricks, AWS EMR
• Experience with Kanban or Agile Scrum development

Who you are:

• Bachelor's degree or foreign equivalent degree in Computer Science or a related field required
• Excellent communication and prioritization skills.
• Able to work independently or within a team proactively in a fast-paced AGILE-SCRUM environment.
• Owns success - Takes responsibility for successful delivery of the solutions.
• Strong desire to improve upon their skills in software development, frameworks, and technologies.

Don't meet every single requirement? We encourage you to apply anyway. You might just be the right candidate for this, or other roles.


#LI-SS9


Who are we?


At Gartner, Inc. (NYSE:IT), we guide the leaders who shape the world.


Our mission relies on expert analysis and bold ideas to deliver actionable, objective insight, helping enterprise leaders and their teams succeed with their mission-critical priorities.


Since our founding in 1979, we've grown to more than 20,000 associates globally who support ~15,000 client enterprises in ~90 countries and territories. We do important, interesting and substantive work that matters. That's why we hire associates with the intellectual curiosity, energy and drive to want to make a difference. The bar is unapologetically high. So is the impact you can have here.


What makes Gartner a great place to work?


Our sustained success creates limitless opportunities for you to grow professionally and flourish personally. We have a vast, virtually untapped market potential ahead of us, providing you with an exciting trajectory long into the future. How far you go is driven by your passion and performance.


We hire remarkable people who collaborate and win as a team. Together, our singular, unifying goal is to deliver results for our clients.


Our teams are inclusive and composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations.


We invest in great leaders who bring out the best in you and the company, enabling us to multiply our impact and results. This is why, year after year, we are recognized worldwide as a great place to work .


What do we offer?


Gartner offers world-class benefits, highly competitive compensation and disproportionate rewards for top performers.


In our hybrid work environment, we provide the flexibility and support for you to thrive -- working virtually when it's productive to do so and getting together with colleagues in a vibrant community that is purposeful, engaging and inspiring.


Ready to grow your career with Gartner? Join us.





The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status, or any other legally protected status and to affirmatively seek to advance the principles of equal employment opportunity.


Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company's career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at +1 (203) 964-0096 or by sending an email to ApplicantAccommodations@gartner.com .


Job Requisition ID:90414
By submitting your information and application, you confirm that you have read and agree to the country or regional recruitment notice linked below applicable to your place of residence.


Gartner Applicant Privacy Link: https://jobs.gartner.com/applicant-privacy-policy

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3389541
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    HR, IN, India
  • Education
    Not mentioned
  • Experience
    Year