Data Engineer

Year    Gurgaon, Haryana, India

Job Description


Description :

The Department

The Life & Annuity Predictive Analytics (LAPA) business unit is a lean, agile, diverse, and geographically distributed data science startup within Milliman. Our team consists of professionals with varied backgrounds including data scientists, data engineers, software engineers/developers, and actuarial domain experts.

We help insurers and distributors of life and retirement products to understand and use their own data, industry data, and customer data to advance their competitive position and improve financial outcomes. Through our powerful combination of subject matter expertise, data management, and advanced analytics, we provide our clients with tools to analyze their business performance, manage risk, and generate new business leads to facilitate more profitable growth.

The Role

As a Data Engineer on the LAPA team, you will be responsible for designing and implementing data pipelines using industry-leading cloud applications such as Databricks and orchestration tools such as Azure Data Factory. You will use programming languages such as Python, R, or SQL to automate the ETL, analytics, and data quality processes from the ground up. You will design and implement complex data models, metadata, build reports and dashboards, and own data presentation and dashboarding tools for the end users of our data products and systems. You will work with leading edge technologies like Databricks, Azure Data Lake, Azure Data Factory, Snowflake, and more. You will write scalable, highly tuned SQL/Pyspark code running over millions of rows of data.

You will work closely with other data scientists, data engineers, software engineers/developers, and domain experts to continuously improve our data collection, data cleaning, data analysis, predictive modeling, data visualization, and application development. You will also investigate, evaluate, and present new technologies and processes for the team to use.

You will:

  • Develop data cleaning and data checking pipelines using Spark SQL/Pyspark on Databricks
  • Perform debugging and root cause analysis on data issues
  • Perform code reviews and automate processes for data extraction, transformation, and loading
  • Lead efforts to minimize technical debt
  • Support the design and development of a machine-learning framework on databricks
  • Support R&D based activities related to predictive analytics and machine learning
  • Document analysis and modeling results. Help build wikis related to data pipelines
Job Knowledge, Experience Skills

Job Knowledge Required
  • Bachelor\xe2\x80\x99s degree in computer science, engineering, or any other STEM field.
  • 2+ years of experience in a data science/data engineering role
  • Experience with data modelling, ETL design, and using cloud data warehouses
  • Strong programming skills in Python and PySpark
  • Software engineering skills for data science (Python, R)
  • Knowledge of Data Engineering and the respective tools and technologies (e.g., Apache Spark, Databricks, Python, SQL DB, Data Lake concepts)
  • Experience working with databases and SQL
  • Understanding of cloud data tools
  • Understanding DevOps, and version control from a Data Engineering perspective.
Experience and Soft Skills Required
  • Passion for technology, growth, self-motivated, energetic, organized, driven, and result oriented.
  • Ability to work in a highly collaborative, Agile environment with a strong desire to learn
  • Ability to take ownership of a technical challenge and see it through to a successful conclusion
  • Commitment to continuous education to be equipped to lead continuous process improvement
  • Excellent written and verbal communication skills
  • Ability to manage competing priorities and deadlines
Additional Knowledge and Skills to Build
  • Sharp critical thinking skills, sound judgment and decision making ability, and both the ability and willingness to clearly articulate your ideas
  • Experience in ETL optimization, writing custom pyspark functions (UDFs) and tuning PySpark or Spark SQL code
  • Experience in using DAG orchestration with tools like Data Factory, Airflow, Prefect etc.
  • Experience in handling data - data lineage, data governance, ensuring data quality, feature stores etc.
  • Knowledge of data engineering best practices and in using industry-standard methodologies.
Milliman & LAPA Practice Mission, Values, Competencies

Our mission is to serve our clients to protect the health and financial well-being of people everywhere.

In fulfilling this mission, Milliman\xe2\x80\x99s professionals are helping our clients answer significant questions, such as:
  • How can people provide for themselves when they no longer work?
  • How can our clients efficiently finance, deliver and improve healthcare?
  • How can an insurer protect its clients against the risks they face?
Since its founding in 1947, Milliman is dedicated to enduring values that govern our actions in the marketplace.
  • Quality \xe2\x80\x93 Milliman\xe2\x80\x99s advice, products and client service adhere to the highest standards of quality.
  • Integrity \xe2\x80\x93 Milliman\xe2\x80\x99s people demonstrate integrity in all that we do. We are committed to honesty and professionalism in our interaction with our clients and colleagues, including independent advice free of conflicts and a culture of inclusion and respect for all colleagues.
  • Opportunity \xe2\x80\x93 Milliman is committed to embracing diversity and providing all our people opportunities to achieve their full potential including opportunities to:
  • Shape their own careers
  • Assist in developing the strategy of their practice
  • Pursue innovations to further Milliman\xe2\x80\x99s mission in the marketplace.
At the Practice level, we strive to demonstrate the following performance competencies in our work:
  • Collaboration and Teamwork \xe2\x80\x93 Actively works with members of other teams when confronted with a new or complex problem. Collaborates with people in other teams when asked to provide assistance. Coordinates work of teammates to complete routine work efficiently.
  • Communication \xe2\x80\x93 Communicates clearly and concisely. Gives enough information, keeps team members informed. Listens effectively. Encourages others to express different ideas and perspectives. Open to constructive feedback. Gives quality, honest feedback. Effectively deals with conflict.
  • Develops People \xe2\x80\x93 Develops team members through coaching, feedback, exposure and challenging assignments. Readily articulates the value and benefit of challenging assignments to others. Aligns career development goals with organizational objectives. Supports team members and helps them achieve results. Provides a clear sense of purpose and direction for team members.
  • Innovation \xe2\x80\x93 Challenges the organization to adapt new and innovative processes. Creates an environment conducive to productive brainstorming and new idea creation. Generates innovative ideas and solutions to problems. Questions assumptions and traditions while understanding their reason for existing. Encourages creative and diverse thinking to promote and nurture innovation.
  • Positive Culture \xe2\x80\x93 Shows respect for all colleagues. Considers \xe2\x80\x9chow\xe2\x80\x9d accomplishments are achieved in equal measure with \xe2\x80\x9cwhat\xe2\x80\x9d is achieved.
  • Quality \xe2\x80\x93 Continuously deepens their expertise in their area(s) of work. Possesses technical skills and capabilities. Effectively manages work for clients and client relationships. Effectively manages work quality within the team. Effectively pursues or supports business development opportunities. Demonstrates good decision making in areas related to managing the business.
Diversity, Equity & Inclusion is an important area of focus for our practice and we expect all colleagues to foster a culture of belonging for all team members. We seek to continuously reflect on how we can be a more inclusive and equitable organization. We view diversity as not only a strength for our practice, but a business imperative to succeed in the marketplace.

For additional conduct expectations, please reference Milliman\xe2\x80\x99s Code of Conduct.

Performance and Career Growth

This job description is intended to represent the duties of the role, and the knowledge, skills and experience needed to perform the role effectively. Our job descriptions will be used to set expectations for performance management, but no job description will represent all tasks and duties required. As professionals, our Practice also expects from you the following:
  • A client centric culture requires all colleagues to think about how we can contribute to exceptional client service. We expect all colleagues to think this way, and to take appropriate action whether a task is in the job description, or not.
  • Performing the duties described in a job description meets the minimum requirements of a job. In order to receive career growth and compensation rewards, colleagues must exceed minimum expectations.
  • There are a number of administrative responsibilities that come with working in our Practice. Timesheets, expense reports, performance management and compliance training are all required to ensure professional administration of our Practice, and all colleagues are expected to engage in these items in a timely manner.

Milliman

Beware of fraud agents! do not pay money to get a job

MNCJobsIndia.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD3210238
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Gurgaon, Haryana, India
  • Education
    Not mentioned
  • Experience
    Year