Note: The job is a remote job and is open to candidates in USA. Quanata is on a mission to help ensure a better world through context-based insurance solutions. They are seeking a Senior Data Engineer to deliver data science services and streaming data pipelines, focusing on developing data pipelines and enabling access to key datasets.
Responsibilities
- Design and build robust data pipelines that integrate data from diverse sources to support risk evaluation and business intelligence
- Build streaming data pipelines using Kafka and AWS services to enable real-time data processing and decision-making
- Create and operate data services that make curated datasets accessible to internal teams and external partners through APIs and scheduled deliveries
- Support data science workflows by building infrastructure that enables model training, feature engineering, and production inference
- Implement data quality frameworks including validation, monitoring, and alerting to maintain trust in our data assets
- Contribute to CI/CD pipelines and infrastructure-as-code practices to ensure reliable, repeatable deployments
- Deliver highly reliable services by following engineering best practices and participating in an on-call rotation to support production systems
- Contribute to the data warehouse by creating well-modeled datasets in Snowflake that empower analysts and data scientists
- Collaborate with data scientists, analysts, and business stakeholders to understand requirements and deliver solutions that drive value
Skills
- Bachelor's degree or equivalent relevant experience
- 6-8 years of industry experience in data engineering or software engineering with a focus on data systems
- Strong proficiency in Python and SQL for data pipeline development and analysis
- Experience with AWS data platforms (Glue, S3, Athena, Lambda, Step Functions)
- Familiarity with Snowflake or similar cloud data platforms
- Familiarity with streaming technologies such as Kafka or Kinesis
- Experience with workflow orchestration tools (Airflow, Step Functions, or similar)
- Proficiency in infrastructure-as-code tools like Terraform
- Understanding of data modeling principles
- Excellent written and verbal communication with a strong collaborative focus
- Experience with CI/CD tailored for machine learning systems (e.g., automating model training, validation, and deployment)
- Prior experience working within the insurance industry or another highly regulated environment, demonstrating an understanding of pertinent regulatory, security, and data governance challenges
- Familiarity with ML infrastructure and supporting data science teams in productionizing models
- Experience designing and building feature stores or real-time feature serving systems
- Exposure to data governance and cataloging tools (e.g., DataHub, Atlan, or similar)
Benefits
- Medical, dental, vision, life insurance and supplemental income plans for you and your dependents
- A Headspace app subscription
- Monthly wellness allowance
- A 401(k) Plan with a company match
- A one-time payment of $2K will be provided to cover the purchase of in-home office equipment and furniture at your discretion
- MacBook Pros, which we will deliver to you fully provisioned prior to your first day
- All employees accrue four weeks of PTO in their first year of employment
- New parents receive twelve weeks of fully paid parental leave which may be taken within one year after the birth and/or adoption of a child
- The twelve weeks is applicable to both birthing and non-birthing parent
- All employees receive up to $5000 each year for professional learning, continuing education and career development
- All team members also receive LinkedIn Learning subscriptions and access to multiple different coaching opportunities through BetterUp
Company Overview
Company H1B Sponsorship