Job Description

Company DescriptionFastmarkets is an industry-leading price-reporting agency (PRA) and information provider for global commodities, providing price data, news, analytics and events for the agriculture, forest products, metals and mining and new-generation energy markets.Fastmarkets' data is critical for customers seeking to understand and predict dynamic, sometimes opaque markets, enabling trading and risk management. Fastmarkets is a global business with a history dating back to 1865 and is built on trust and deep market knowledge. It has more than 600 employees spread across global locations in the UK, US, China, India, Singapore, Brazil, Belgium, Finland and beyond.As a Full Stack Data Engineer, you will be integral in developing and maintaining our next-generation digital analytics application. You will be building scalable web applications, designing robust data pipelines, and ensuring seamless data integration and processing. This role requires a unique blend of data engineering and software development expertise to design, develop, and maintain both the backend infrastructure and data pipelines that support our platform. You will work closely with cross-functional teams, including data analysts, Power BI developers, and UX/UI designers, to create a reliable and efficient data infrastructure that supports advanced analytics and reporting.Principal AccountabilitiesDevelop and maintain robust front-end and back-end components of web applications, ensuring software quality, security, and maintainability through rigorous testing and code reviews.Design, build, and maintain data pipelines to extract, transform, and load (ETL) data from various sources, optimizing data storage and retrieval processes for performance and scalability.Design, develop, and maintain scalable data pipelines to extract, transform and load (ETL) data form various sources, optimizing data storage and retrieval processes for performance and scalability using Dagster.Build data workflows that ensure high availability, reliability, and performance.Integrate data from various sources (databases, APIs, event streams) into data lakes and warehouses.Monitor, troubleshoot, and optimize data workflows for performance and scalability.Create efficient data models and schemas to support the platform's analytical and operational needs using SQL and NoSQL databases.Design, develop, and maintain RESTful APIs using industry standards to expose data and functionality to frontend applications.Collaborate with data engineers, data analysts, and Power BI developers to integrate data sources into the analytics platform, providing technical guidance and mentorship to junior developers.Deploy tested software applications and updates to production environments, troubleshoot and resolve issues related to data pipelines, application performance, and data integration, and implement monitoring and alerting mechanisms to ensure data pipeline reliability.QualificationsWe recruit talented, dynamic people with diverse backgrounds and experiences, all united by a belief in our mission to provide the worldxe2x80x99s leading and most trusted price reporting, events, and intelligence service for the markets we serve. Wexe2x80x99re proud to be an equal opportunities employer and are committed to creating a fully inclusive workplace, where everyone feels able to participate and contribute meaningfully.If you are open-minded, curious, resilient, solutions-oriented and committed to promoting equality, then read on.KNOWLEDGE, EXPERIENCE AND SKILLSWe are looking for an individual who is highly motivated, driven, and have a passion to be part of a fast-paced, successful team. Being a strong team player is also important as well as someone who is happy to work flexibly.10+ years of experience in building data pipelines and backend development using Python, Java, or Node.js with proficiency in frameworks like Django, Flask, Spring Boot, or Express.js.Proficiency in Dagster for workflow orchestration, including creating solids, pipelines, and schedules.Strong programming skills in Python or similar languages.Experience with SQL and database systems (e.g., PostgreSQL, MySQL, Snowflake, BigQuery).Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.Expertise in building and maintaining data pipelines and ETL processes, with knowledge of data structures, algorithms, and data analytics; experience with big data technologies like Hadoop, Spark, or KafkaStrong understanding of relational and NoSQL databases. Proficiency in database design and optimization.Experience in designing, developing and maintaining RESTful APIs using industry standards.Knowledge of CI/CD pipelines and automated testing frameworksExperience in creating efficient data models and schemas.Strong analytical and problem-solving skills.Experience with frontend development technologies (HTML, CSS, JavaScript) is a plus.If you're excited about the role but your experience, skills or qualifications don't perfectly align, we encourage you to apply anyway.Additional InformationOur ValuesFastmarkets people come from all different walks of life. Itxe2x80x99s this mix of brilliant personalities, experiences and insights that gives us that warm, open, and friendly culture you can feel as soon as you meet us. But however wonderfully different we all are, there are six things we all have in common xe2x80x93 and they form our Fastmarkets values.Created by our own employees to reflect some of the personal traits that Fastmarkets people have, our values are key to what makes our culture unique. They reflect who each of us are and they're embedded in everything we do. Our values are:

• METRICS DRIVEN. We use insights to improve our customersxe2x80x99 experience and our business performance

• ACCOUNTABLE. We are accountable to ourselves and those we work with: we keep our promises and get things done

• GROWTH MINDSET. This value enables us to be nimble to the changing realities and operate with a sense of urgency

• INCLUSIVE. We are inclusive and respectful, celebrating each of us and giving everyone a deep sense of belonging with the desire to bring their best self to work every day.

• CUSTOMER CENTRIC. We are customer-centric in all that we do

• COLLABORATIVE. We are collaborative, able to work across teams and capitalise on the diversity of intellect, perspectives, and experiences.

Youxe2x80x99ve read a little about us xe2x80x93 now itxe2x80x99s over to you!If you like what youxe2x80x99ve read so far and think you can see yourself as a Fastmarkets person, itxe2x80x99s time to fill in your application form. This form is an important part of the selection process: itxe2x80x99s used to determine whether or not youxe2x80x99ll be chosen to have an interview and acts as a basis for the questions wexe2x80x99ll ask you on the day.Itxe2x80x99s vital that you try to capture all the relevant information we have asked for on the form so we can get a good feel for who you are and why youxe2x80x99re great.

Fastmarkets