Job Description

DESCRIPTIONWould you like to build highly available & performant data processing architectures for one of the largest data lakes in Amazon? Does Petabyte scale excite you?The Analytics & Data Management (ADM) team owns the central data lake for Advertising unifying Petabytes of data generated across the Ads pipeline such as campaigns, ad-serving, billing, clicks, impressions and more and into a single scalable repository. This is used across the organization to drive hundreds of thousands of complex queries for analysis, measurement and reporting decisions for our customers. The data lake enables customers such as data engineers, software engineers, business analysts, ML engineers, research scientists, economists and data experts to collect what they need via world-class self-service tools.ADM is building the next version of its data lake for 5x growth. A Data Engineer on the ADM team has a unique opportunity to design and innovate for the Ads scale, work with like-minded SDEs/DEs to deliver robust and scalable data storage, streaming and BI infrastructure solutions all the while improving quality and discoverability of the data lake. You work will encompass a comprehensive suite of distributed systems technologies, AWS products such as EMR, S3 and Athena, and frameworks such as as Spark. You will create value that materially impacts the speed and quality of decision making across the organization resulting in tangible business growth.Key job responsibilities
- Engage with key decision makers such as Product & Program Managers to understand customer requirements and brainstorm on solutions
- Design and deploy data solutions such as models, optimized storages and self-serve intelligence tools
- Ensure testability, maintanability and low operational footprint for your code
- Participate in operational responsibilities with your team
- Innovate on AWS technology to improve latency, reduce cost and operationsA day in the life
- Focus on core data engineering opportunities to guarantee high data quality and discoverability
- Work with a skilled team of engineers, managers and decision makers to consistently meet customer demand
- Automate monitoring of solutions and systems and deliver operational controls to improve guarantees for our customers
- Build frugal solutions that will help make Spektr data lake cost wise the leanest datalake in AmazonAbout the team
The mission of the Analytics & Data Management (ADM) team is to provide data that helps the advertising organization make informed analyses and decisions for our customers and to determine and deploy investments for future growth via a set of central and unified products and services.
Our team focuses on simplicity, usability, speed, compliance, cost efficiency and enabling high-velocity decision making so our customers can generate high quality insights faster.We are a global team with presence across IN and NA.BASIC QUALIFICATIONS- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelinesPREFERRED QUALIFICATIONS- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)

Amazon