Note: The job is a remote job and is open to candidates in USA. American College of Chest Physicians is seeking a Temporary Independent Contractor Data Engineer. The role primarily involves maintaining, monitoring, troubleshooting, and enhancing production data pipelines and database systems, with a strong focus on CRM Support and collaboration with various teams.
Responsibilities
- Maintain data ingestion processes to Snowflake and MS SQL Server from a wide variety of data sources using Python, ELT tools, SSIS, and automation script
- Design and develop Snowflake and MS SQL Server database objects and procedural code to support various custom and third-party applications, including stored procedures, functions, and trigger
- Maintain and develop test and production environments that support CHEST’s CRM platform
- Optimize and tune SQL queries in both Snowflake and MS SQL databases by normalizing and denormalizing data as needed, while monitoring performance
- Monitor the day-to-day reliability of data ingestion and backup processes on production system
- Collaborate with application developers and data analysts to provide data services and support for existing and new applications while maintaining data integrity
- Engineer large, complex data sets that meet business requirements while maintaining an optimal data pipeline
- Work with stakeholders including the Product, Data and Web Development and Design teams to assist with data-related technical issues and support their data infrastructure needs
- Support and troubleshoot application issues and document solutions
- Identify, design, and implement process improvement
- Perform deployment activities to pre-production and production system
- Ensure quality and stability of the databases, while implementing efficiencies to reduce application and database support cost
- Work with the data analysts to build the production frameworks to orchestrate data pipelines, and automate workflow management in Snowflake, MS SQL, and other platforms as required
- Perform problem-solving of application issues and production errors, including high level critical production issues that require immediate attention
Skills
- 3 + years working with Snowflake, MS SQL Server
- 3+ years of practical experience with SQL and database maintenance, including stored procedures and SSIS packages
- Understanding of data modeling concepts (e.g., star schema, normalization) and ETL/ELT design practices
- Git fundamentals, Agile development, and CI/CD practices
- Demonstrated experience working with CRM systems and data integrations
- Degree in Computer Science, Software Engineering, Information Technology, Mathematics, or a related field required
- Demonstrated experience working with scripting languages (Python preferred)
Company Overview