Lead Data Engineer Pyspark Hyderabad

Year    Hyderabad, Telangana, India

Job Description


To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job Category Software EngineeringJob DetailsAbout SalesforceWere Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good - youve come to the right place.Salesforce is embarking on our own Digital Transformation to deliver customer success for our customers and accelerate our growth. A key pillar of this transformation is building a strong data foundation to support all of our core marketing needs through intelligent data sets as a service.Were looking for an experienced and committed data engineer to build data pipelines and metrics for sales and marketing organization. In this role, you will work with business partners across Marketing functions to understand business needs, translate them to technical requirements, wrangle data from various systems, and design automated data pipelines to drive insights. You will work with internal technology groups to automate the data collection and definition process.The right candidate will have strong data architecture, ETL, SQL and a proven track record working with enterprise metrics to build automated data pipelines. The candidate will also have strong operational skills to drive efficiency and speed, expertise building repeatable data engineering processes, strong project management skills, and a vision for how to deliver data products. Experience with marketing and sales data and metrics is a huge plus.ResponsibilitiesActively develop, enhance and maintain data pipelines and workflows for marketing data and metrics.Work with marketing teams across the organization and build data metric requirements, build quick POCs, document functional and technical requirements.Develop the frameworks and automations in ETL processesDevelop PySpark and DBT ETL pipelines for data ingestion and transformation.Maintaining , deploying and code versioning the ETL process.Using GIT CI/CD for Devops.Work with the business stakeholders, analyze the metrics and build data insights.Help in building POC solutions for new marketing metrics that drive effective decision making.Design & develop easy, repeatable and reusable automation data frameworks.Responsible for end-to-end data management activities, including but not limited to identify fields, data lineage and integration, performing data quality checks, analysis and presenting data.Manage business intelligence and data warehouse plans across MarketingReview and validate logical and physical design to ensure alignment with the defined solution architecture. Review solution design and ensure that the defined standards and framework are followed.Evaluate, determine root cause and resolve critical issues.Work with internal team members and external partners to support data collection and analysis and understand reporting needsCollaborate with Data Science teams and support them with all the data they would need to produce their models.Work and collaborate with global teams across North America, EMEA and APAC.Manage technical consultant(s)Required Skills/ExperienceBachelor's Degree in Computer Science or a related discipline, with 7+ years related information systems experience in a data engineering, data modeling, automation and analyticsDeep understanding of data engineering concepts, database designs ,associated tools, system components, internal processes and architecture. .Experience working as a technical lead/solution architect in a customer-focused teamExperience working closely with Analytics/Data Science teamsTeam-first mentality. Excellent interpersonal skills in order to build strong relationships that will be critical for the success in this role.Must be able to proactively communicate status and identify risksSelf-starter, highly motivated, able to shift directions quickly when priorities change, think through problems to come up with innovative solutions and deliver against tight deadlines.Must be results oriented and able to move forward without complete information and with minimal supervisionWell versed with Snowflake.Experience with ETL technologies like PySpark and Dbt.Proficiency with SQL, Bash and Python scriptingAirflow, CI/CD pipelines via Jenkins or similar tools, GithubExperience with data visualization tools like Tableau is a plus.Experience working with globally distributed engineering teams preferred.Experience with Marketing technology and work is a plus.AccommodationsIf you require assistance due to a disability applying for open positions please submit a request via this .Posting StatementAt Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at and explore our company benefits at .is an Equal Employment Opportunity and Affirmative Action Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. does not accept unsolicited headhunter and agency resumes. will not pay any third-party agency or company that does not have a signed agreement with .\xef\xbb\xbfSalesforce welcomes all.

Salesforce

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3328334
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Hyderabad, Telangana, India
  • Education
    Not mentioned
  • Experience
    Year