Lead Data Engineering(aws,glue,pyspark,databricks)

Year    Bangalore, Karnataka, India

Job Description


:Exp : 7-9 YearsLoc: Bangalore, Hyderabad,Pune,Chennai,Trivandrum,KochiUST is looking for a Data Engineers Experience Required (Must have): Experience in technical leadership in architecture, design, and engineering in the modernization of legacy Data Ingestion, ETL, and databases to new technologies in the Public Cloud (AWS) and Big Data Space Strong understanding across any of the Cloud (AWS) and its components (compute, storage, data, serverless compute,) to deliver end to-end ETL and infrastructure architecture solutioning for the clients Experience in defining technical direction and roadmap for Cloud migrations and managing the implementation and big data technical solutions. Good experience in Lambda, Glue, EMR and Redshift for Data warehousing. Experience in designing, development, or maintenance of a big data application. Produce solutions that are models of performance, scalability, and extensibility. Can create proof of concepts, demos, and/or scripts from scratch or leveraging reusable components. At least 5 years of experience in Data warehousing and designing solutions on Modern Data Lake. At least 5 years of Experience with major Big Data technologies and frameworks including but not limited to Hadoop, Apache Spark, Hive, Kafka, HBase/MongoDB. Practical expertise in performance tuning and optimization Experience work on Production grade projects with Terabyte to Petabyte size data sets. Experience reviewing and implementing DevOps and Agile standards and practices. Secondary skills (Good to have): Proficiency in any of the programming languages: Scala, Python, or Java Good to have knowledge on working with Presto. Must have conceptual knowledge of Data Lake and ETL Experience in cloud data warehouses like a snowflake. Hands on Experience with Spark (Python/Scala), SQL. Good analytical and problem-solving skills for design, creation, and testing of programs. Good communication skills to interact with team members, support personnel, and provide technical guidance and expertise to customers and management. Good interpersonal skills to interact with customers and team members. Should be ready to explore or work with Cloud technologies. Ability to work in a self-directed work environment. Ability to work in a team environment. Roles & Responsibilities: Total Experience: 10+ years Propose solution architectures and manage the deployment of cloud based big data and analytics solutions, according to complex customer requirements and implementation best practices. Review, validate and assess client's requirements, and product's specifications/features. Create the required artifacts (design document, diagrams, STTM, HLD, LLD, etc.) Architect, design, and implement data solutions in the Public Cloud (Azure/AWS) and Big Data Space Work closely with customer and internal teams to gather business and technical requirements. Develop a point of view, capture, prioritize and analyze technical (functional and non-functional) requirements Apply Architectural Methods, Techniques and Best Practices. Educate, mentor and coach teams in applying architectural techniques Successfully lead Customers migration and transformation projectsSkills:AWS,Glue,Databricks,PysparkAbout Company:UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the worlds best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients organizations. With over 30,000 employees in 30 countries, UST builds for boundless impactxe2x80x94touching billions of lives in the process.

UST

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3538065
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bangalore, Karnataka, India
  • Education
    Not mentioned
  • Experience
    Year