Lead Data Engineer DevOps
- Data Warehouse Performance Engineer
We are looking for Datawarehouse Performance Engineers who are passionate about data warehousing, love to analyze data management systems and workloads to make them faster and easier to use. You will work with the data and cloud engineering team to develop performance bottleneck analysis, analyze and recommend performance scaling inputs into new features, analyze regressions in performance, scale performance for new cloud instance, database versions and database features. You should have a forward-looking attitude and an inclination for digging deep to attack difficult and complex performance problems, and drive improvements to deliver for our customers.
This is a unique and rare opportunity to get in on floor within a fast-growing business and help shape the technology, process, and the business. You will bring deep technical, systems and analytics expertise with the ability to work in an industry leading Manufacturing company to deliver a broad business impact.
Diversity & Inclusion
We always invite all perspectives, work together as a truly global team, and respect our unique strengths to create a diverse and inclusive culture where ideas and voices are heard
Work/Life Balance
Our team puts a high value on work-life balance. It isnt about how many hours you spend at home or at work; its about the flow you establish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life-long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.
Mentorship & Career Growth
Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and were building an environment that celebrates knowledge sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.
Key Job Functions
Work with Data Leads, database engineers and solution architects to analyze performance bottlenecks, make recommendations for scaling, automated performance regression testing and analysis, co-design performance into new feature development.
Design operations architecture and conduct performance engineering for large scale data lakes in production environment
Understand database internals, server and storage system design, application interactions with database queries and stored procedures
Collaborate with engineers, database engineers, solution architects, product management to design new functionality
Build and run automation and benchmark tests to improve quality, performance, and scalability
Run database benchmark workloads
Analyze new designs for performance and scaling
Research issues experienced by customers and find or invent solutions
Key Technologies: Postgres, Redshift, MySQL, Oracle
Postgres design and development, including logical and physical schema design
Postgres application performance tuning and optimization
DB query monitoring for tuning and optimization opportunities
DB partition/index management, ensure teams are using modern strategies
DB pruning/compression for storage optimization
Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, RDS
BASIC QUALIFICATIONS
Bachelor or masters degree in information technology, Electrical Engineering or similar relevant fields.
Experience with Database Performance bottleneck analysis and system design for scaling
Experience analyzing performance bottlenecks with application code interfacing with databases, cache layers, data storage, servers, networking, database query protocols including developing stored procedures, SQL queries, and database applications
Experience with one or more of database internals, OS internals, storage system internals and performance scaling for these
Working knowledge of at least one at least one stored procedure language (SQL, pgSQL), at least one scripting language (Shell scripting, Python, PERL)
Proven experience with large, complex database projects in environments producing high-volume data
PREFERRED QUALIFICATIONS
Proven experience with Postgres physical and logical table design, performance tuning and optimization
Very good knowledge of data warehouse architecture approaches and trends, and high interest to apply and further develop that knowledge, including understanding of Dimensional Modelling
Experience in preparing data warehouse design artifacts based on given requirements
Experience implementing automated performance regression test suites for databases
Experience analyzing performance bottlenecks with application code interfacing with databases, cache layers, data storage, servers, networking, database query protocols including developing stored procedures, SQL queries, and database applications
Working knowledge of operating system internals and/or relational database internals (locking, consistency, serialization, system recovery)
Having working Experience in ETL tool (preferably Pyspark) is added advantage
Experience working directly with internal or external customers, resolving issues and providing architecture leadership
Information about our benefits you can find here:
MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.