Why This Role Is Important to Arcadia
Life sciences customers depend on Arcadia's real-world data to power drug development, safety surveillance, and outcomes research. As LS deal volume accelerates, the engineering foundation underneath delivery, i.e. quality, automation, data transformation evolution, and scale must keep pace.
This is a hybrid role at the intersection of data engineering, data analysis, and delivery operations. You'll refactor, scale, own, and operate an automated RWD data delivery pipeline via dbt/AWS architecture, serving as the primary technical point of contact for channel partners.
You write production-grade PySpark and dbt one day and may facilitate a data inquiry the next. You care deeply about both the correctness of the code and the clarity of the answer it produces. You're as comfortable in a GitHub PR as you are in a partner meeting.
This is a foundational engineering role in a growing LS organization. The right person will help build the team as the business scales.
What Success Looks Like
In 3 months
Deep familiarity with the end-to-end LS pipeline-from ingestion through dbt transformation, de-identification, and delivery-including the current Snowflake-based scripts and what will replace them
Ownership of the channel partner data inquiry queue; resolving standard requests independently by leveraging AI agents, closing out in writing and in accordance with SLAs
First contribution to the delivery pipeline codebase: a new or refactored dbt model, a PySpark debugging fix, or a validated QC delivery configuration
Thorough understanding of the monthly delivery cycle: Argo orchestration, Snowflake execution, manifest generation, Datavant/HealthVerity/IQVIA tokenization, and delivery QC
In 6 months
Core delivery endpoint configurations migrated from manual Snowflake runbook to config-as-code; existing channel partners delivered with minimal manual script execution
Contributing increasingly receptive metrics toward a data quality scorecard, tracking pipeline health, completeness, and refresh SLAs across all channel partners
PHI de-identification compliance implementation process owned end-to-end, with clear documentation of rules applied
Strong working partnerships established with platform engineering (Data Engineering, TechOps) with clear interfaces and shared standards
In 12 months
Monthly delivery cycle runs automatically; manual Snowflake execution eliminated; delivery cycle time reduced
Recognized internally as the technical authority on the LS data engineering architecture and delivery pipeline
Test suites, acceptance criteria, and release documentation authored for all major pipeline changes
Potentially beginning to mentor a junior team member as the LS delivery organization grows
RWD DATA PIPELINE ENGINEERING
Education
About Arcadia
Arcadia.io helps innovative providers and payers across the country transform healthcare to reduce cost while improving patient health. We do this by aggregating large amounts of disparate data, applying algorithms to identify opportunities to provide better patient care, and making those opportunities actionable by physicians at the point of care in near-real time. We are passionate about helping our customers drive meaningful outcomes. We are growing fast and have emerged as a market leader in the highly competitive population health management software market and have been recognized by industry analysts KLAS, IDC, Forrester, and Chilmark for our leadership. For a better sense of our brand and products, please explore our website.
Protect Yourself
If you have concerns about the authenticity of a job offer or recruitment-related communication claiming to be from Arcadia, we encourage you to verify by contacting us directly at (781) 202-3600 and select option 3. For more information, visit our website.
This position is responsible for following all Security policies and procedures in order to protect all PHI under Arcadia's custodianship as well as Arcadia Intellectual Properties. For any security-specific roles, the responsibilities would be further defined by the hiring manager.
