Senior data
engineer

Promise & Proof is an applied AI consulting and implementation firm in New York. We find where frontier AI belongs in a business, ship it to production, and tie the result to the P&L. We are a senior team of operators and forward deployed engineers who have run data and AI inside global enterprises and built it hands-on in startups. We work in any industry, including across private equity portfolios; our published case studies come from media, streaming, sport, and ad tech.

As a Senior Data Engineer, you will build the data foundations our AI systems run on: the pipelines, models, and serving layers that turn a client’s data into something a model can use and a business can trust. Some of our builds serve decisions in milliseconds; others turn raw data into products clients sell. You will work inside client teams alongside forward deployed engineers, from the scoped brief through rollout.

• Design and build data pipelines and models on client platforms, batch and streaming
• Build retrieval and embedding pipelines, and choose vector stores with the forward deployed engineers
• Build low-latency data services where decisions need to happen in milliseconds
• Put data quality, lineage, and access controls in place so AI systems can be trusted and governed
• Turn client data into data products with clear owners, documentation, and measurable use
• Document patterns as reusable reference implementations
• Work in person with clients and the team in New York at least 25% of the time, more when an engagement needs it

• Have 5+ years of experience building production data pipelines and platforms
• Write excellent SQL and Python
• Have worked with modern data platforms such as Snowflake, BigQuery, or Databricks, and orchestration tools such as Airflow or dbt
• Can explain data trade-offs to non-technical stakeholders
• Take ownership of quality and reliability, not only delivery

• Geospatial data, or high-throughput, low-latency serving at thousands of queries a second
• Audience, identity, or advertising data
• Streaming systems such as Kafka
• Experience preparing data for LLM applications: retrieval, embeddings, and evaluation sets

None. Applications are reviewed on a rolling basis.

The annual compensation range for this role is listed below.

Education requirements: we require at least a bachelor’s degree in a related field, or an equivalent combination of education, training, and experience.

Location-based hybrid policy: We expect everyone to be in person in New York, with the team or at client sites, at least 25% of the time. Some engagements require more.

Visa sponsorship: we are not able to sponsor visas for this role at this time.

We encourage you to apply even if you do not meet every qualification listed. Strong candidates rarely check every box, and people from underrepresented groups are more likely to rule themselves out too early. If the work excites you, apply.

We are small on purpose. The people who scope the work are the people who build it, and success is defined before the first line of code: revenue, margin, hours reclaimed, adoption. We build with whichever frontier model fits the job, and every win becomes a playbook, so what you learn on one engagement compounds on the next.

Competitive compensation and benefits, generous vacation and parental leave, and flexible working hours.

We only contact candidates from @promiseandproof.com addresses, and we never ask for payment or financial details at any stage of hiring.

Promise & Proof is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, or any other characteristic protected by law.