Job Description

Role - Senior Data EngineerExperience - 5-8 YrsLocation - Bangalore (Work from Office)About Role :We are seeking an experienced Senior Data Engineer to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure to support our data processing needs. This role requires a deep understanding of data architecture, ETL processes, and big data technologies. The ideal candidate will have strong problem-solving skills and a passion for building robust and efficient data systems.Responsibilities:

• Data Pipeline Development: Design, develop, and maintain robust data pipelines to ingest, process, and transform large volumes of structured and unstructured data from diverse sources.
• Data Modeling: Design and implement data models that meet the business requirements for analytics, and reporting applications. Optimize data models for performance and scalability.
• ETL Processes: Develop efficient Extract, Transform, Load (ETL) processes to cleanse, enrich, and aggregate raw data into usable formats for analysis and reporting.
• Data Integration: Integrate data from various internal and external sources, ensuring data quality, consistency, and integrity throughout the process.
• Performance Optimization: Identify and address performance bottlenecks in data pipelines and queries. Optimize data processing workflows for speed, efficiency, and reliability.
• Data Warehousing: Design and maintain data warehouse solutions for storing and querying structured data. Implement best practices for data partitioning, indexing, and compression.
• Monitoring and Maintenance: Monitor data pipelines and systems for errors, anomalies, and performance issues. Develop and implement proactive measures to ensure data quality and system reliability.
• Documentation and Collaboration: Document data pipelines, data models, and system architectures. Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and deliver solutions.

Requirements :

• Bachelor\'s or Master\'s degree in Computer Science, Engineering, or a related field.
• 5+years of experience as a Data Engineer, with a focus on building and maintaining large-scale data infrastructure.
• Proficiency in programming languages such as Python and Java.
• Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL).
• Experience with NoSQL databases such as MongoDB and DynamoDB.
• Familiarity with cloud platforms such as AWS.
• Solid understanding of data warehousing concepts and architectures.
• Experience with data modeling, ETL processes, and data integration techniques.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

About My Gate :MyGate has revolutionized the way security is managed at gated premises (Residential, Commercial, Office Spaces and Educational Institutes), and by seamlessly connecting users to their security gates through our apps, we make gated premises more secure. With MyGate, we have built a tech focused scalable product that is used across geographies. Today, MyGate is operational in Bengaluru, Hyderabad, Mumbai, Ahmedabad, Chennai, Pune, NCR etc. While it started as a security management app, MyGate is additionally providing communities with wholesome facilities like home services, utilities, maintenance, and other payments, buy or rent properties and many more. Making it an indispensable part of community living.Founded by ISB/IIM/IIT alumni, MyGate has raised funding from institutional investors and is well capitalized for massive growth plans.As part of our new initiative, "Smart Devices," we are expanding our product line to include a range of smart devices that integrate seamlessly with our existing security systems. We are looking for talented and passionate Embedded Firmware Developers to join our team and contribute to the development of cutting-edge smart devices.Company Website : https://mygate.com/

Nexthire