Job Description

Job Role: Senior Data Engineer Grade : Internal purpose only What Is In For You As a Data Engineer at S&P Global, you will utilize your extensive technical skills to architect, build, and maintain our evolving data infrastructure, which is essential for supporting our advanced analytics and machine learning initiatives. You will work closely with various stakeholders to acquire, process, and refine vast datasets, focusing on creating scalable and optimized data pipelines. Your work will be pivotal for enabling data scientists to extract meaningful insights and develop AI-driven solutions that serve various business purposes, from internal decision-making to product development. Responsibilities To collaborate with stakeholders, including data scientists, analysts, and other engineers, to understand and refine requirements related to data processing and transformation needs. To design, construct, install, and maintain large-scale processing systems and other infrastructure. To build high-performance algorithms, prototypes, and conceptual models and enable the efficient retrieval and analysis of data. To implement ETL processes to acquire, validate, and process incoming data from diverse sources. To ensure data architecture and model adhere to compliance, privacy, and security standards. To work in conjunction with data scientists to optimize data science and machine learning algorithms and models. To provide technical expertise in the resolution of data-related issues, including data quality, data lineage, and data processing errors. To manage the deployment of analytics solutions into production and maintain them. To maintain high-quality processes and deliver projects in collaborative Agile team environments. Requirements 5 - 7+ years of programming experience particularly in Python, R, Java or C#. 3 - 4+ years of experience working with SQL or NoSQL databases. 1+ years of experience working with Pyspark. University degree in Computer Science, Engineering, Mathematics, or related disciplines. Strong understanding of big data technologies such as Hadoop, Spark, or Kafka. Demonstrated ability to design and implement end-to-end scalable and performant data pipelines. Experience with workflow management platforms like Airflow. Strong analytical and problem-solving skills. Ability to collaborate and communicate effectively with both technical and non-technical stakeholders. Experience building solutions and working in the Agile working environment Experience working with git or other source control tools Nice To Have Experience working with Oil, gas, and energy markets. Familiarity with BI Visualization applications (e.g. Tableau, Power BI). Understanding of cloud-based services, preferably AWS. Experience working with Unified analytics platforms like Databricks. Experience in managing and deploying containerized applications using Docker, Kubernetes, or similar technologies. Machine learning/Data Science experience About S&P Global Platts At S&P Global Platts, we provide the insights; you make better informed trading and business decisions with confidence. We\'re the leading independent provider of information and benchmark prices for the commodities and energy markets. Customers in over 150 countries look to our expertise in news, pricing and analytics to deliver greater transparency and efficiency to markets. S&P Global Platts coverage includes oil and gas, power, petrochemicals, metals, agriculture and shipping. S&P Global Platts is a division of S&P Global (NYSE: SPGI), which provides essential intelligence for individuals, companies and governments to make decisions with confidence. For more information, visit www.platts.com. Equal Opportunity Employer S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment. If you need an accommodation during the application process due to a disability, please send an email to: [HIDDEN TEXT] and your request will be forwarded to the appropriate person. US Candidates Only: The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law. 20 - Professional (EEO-2 Job Categories-United States of America), IFTECH202.1 - Middle Professional Tier I (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning) Job ID: 295136 Posted On: 2023-12-14 Location: Hyderabad, Telangana, India

foundit