Job Description

Job title : Senior Lead Spark Developer Location: Pune About Barclays Barclays is a British universal bank. We are diversified by business, by different types of customers and clients, and by geography. Our businesses include consumer banking and payments operations around the world, as well as a top-tier, full service, global corporate and investment bank, all of which are supported by our service company which provides technology, operations and functional services across the Group. Risk and Control Objective Ensure that all activities and duties are carried out in full compliance with regulatory requirements, Enterprise Wide Risk Management Framework and internal Barclays Policies and Policy Standards. Working Flexibly We\'re committed to providing a supportive and inclusive culture and environment for you to work in. This environment recognises and supports ways to balance your personal needs, alongside the professional needs of our business. Providing the opportunity for all our employees, globally to work flexibly empowers each of us to work in a way that suits our lives as well as enabling us to better service our customers\' and clients\' needs. Whether you have family commitments or you\'re a carer, or whether you need study time or wish to pursue personal interests, our approach to working flexibly is designed to help you balance your life. If you would like some flexibility, then please discuss this with the hiring manager, and your request will be reviewed subject to business needs. BUK & BX - All locations We are currently in the early stages of implementing a hybrid working environment, which means that many colleagues spend part of their working hours at home and part in the office, depending on the nature of the role they are in. We\'re flexible on how this works and it may continue to change and evolve. Depending on your team, typically this means that colleagues spend a minimum of between 20% to 60% of their time in the office, which could be over a week, a month or a quarter. However, some colleagues may choose to spend more time in the office over a typical period than their role type requires. We also have a flexible working process where, subject to business needs, all colleagues globally are able to request work patterns to reflect their personal circumstances These requests will be reviewed and agreed for a period of time i.e., will have a start and end date. Please discuss the detail of the working pattern options for the role with the hiring manager. Introduction: This role will support Compliance team in building and implementing a data lake which will promote and facilitate a data-led approach for the identification and disruption of compliance activities. . Serves as SME for Big data core engineering and align his/her understanding with overall purpose of the project and contribute in design, development, testing and maintenance on Big Data Platform. . Supports the Project Manager as well as Architect Owners in build frameworks and technical design and develop code with clear scope and acceptance criteria in line with Agile delivery methodology. . Act as a Senior developer and generate flow diagrams, tables, mock-ups and other methods to ensure features and stories are presented without ambiguity when designing the solution. . Technical ownership of code delivery and ensuring code quality is maintained. . Involve in test phases and work towards early resolution of defects and ensuring permanent fix. . Effective liaison with Infrastructure, Hadoop admin and other engineering teams. . Technical Design, Develop and Implement Change Requests (CR) for Business. . Adhere to Agile methodology, ensure requirements documentation complies with Agile and audit standards. . Adhere to all Barclays, Group centre and compliance technology standards, policies and governance practices. . Contributes to and use best practices and standards including Barclays Values & Behaviours. What will you be doing . As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, HIVE, Impala) and related technologies. . Technical Design and development of ETL/Hadoop and Analytics services /components. . Contribute in end to end architecture and process flow. . Understand Business requirement and publish reusable designs. . Result oriented approach with ability to provide apt solutions. . Proficient in performance improvement & fine-tuning ETL and Hadoop implementations. . Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies. . Can work independently with minimum supervision. . Strong analytical and problem solving skills. . Experience/Exposure to SQL, advanced SQL skills. What we\'re looking for: . Bachelor\'s Degree. . 0-4 years of experience. . Relevant years of Hands-on experience with ETL process and tools. . Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, HIVE, Impala) and related technologies. . Hands on experience with batch data ingestion. . Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch). . Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli). . Solid Grasp of data storage formats (Parquet, Avro, Cassandra). . Understanding of Agile methodologies as well as SDLC life-cycles and processes. . Strong Understanding of Data warehousing and lakes. Skills that will help you in the role : . Exposure to ETL tools like (Ab Initio, Informatica) would be preferred. . Experience in working on Cloud Infrastructure at an enterprise level. . Familiarity with Tableau, Python or R is a plus. . Prior experience in working with REST API. . Familiarity with Financial service domain. . Very Good communication and organizational skills. . Very Good analytical skills. . Promote Automation, reusable components. . Ability to understand business requirements and design software solutions. . Strong data analysis skills and ability to present the findings to the business users. . Quick learner strong analytical and problem-solving skills, with the ability to deal with numerous tasks simultaneously and with frequently changing priorities. . Demonstrable ability to communicate and build relationships with members of the business and technology communities. . Strong written and verbal communication skills. . Must be independent and creative in approach to problems and issues assertive, tenacious, proactive. Where will you be working Pune Be More at Barclays At Barclays, each day is about being more - as a professional, and as a person. \'Be More @ Barclays\' represents our core promise to all current and future employees. It\'s the characteristic that we want to be associated with as an employer, and at the heart of every employee experience. We empower our colleagues to Be More Globally Connected, working on international projects that improve the way millions of customers handle their finances. Be More Inspired by working alongside the most talented people in the industry, and delivering imaginative new solutions that are redefining the future of finance. Be More Impactful by having the opportunity to work on cutting-edge projects, and Be More Valued for who you are. Interested and want to know more about Barclays Visit home.barclays/who-we-are/ for more details. Purpose, Values and Mindset We deploy finance responsibly to support people and businesses, acting with empathy and integrity, championing innovation and sustainability, for the common good and the long term. Our values underpin everything we do: Respect, Integrity, Service, Excellence and Stewardship. Respect We harness the power of diversity and inclusion in our business, trust those we work with, and value everyone\'s contribution. Integrity We operate with honesty, transparency and fairness in all we do. Service We act with empathy and humility, putting the people and businesses we serve at the centre of what we do. Excellence We champion innovation, and use our energy, expertise and resources to make a positive difference. Stewardship We prize sustainability, and are passionate about leaving things better than we found them. Our Mindset shapes how we take action, living by our Values, driven by our Purpose, always with our customers and clients at the heart of what we do our Mindset is to Empower, Challenge and Drive. Empower Trust and support each other to deliver. Make decisions with those closest to the topic. Include diverse perspectives. Celebrate success and learn from failure. Challenge Question whether things can be done better. Use insights based on data to inform decisions. Be curious about how we can adapt and improve. Speak up and be open to alternative viewpoints. Drive Focus on outcomes. Deliver with pace. Be passionate and ambitious about what we do. Take personal responsibility. Actively build collaborative relationships to get things done. #Data Engineering and analytics

foundit