Senior Data Engineer at Shaped (W22)
$130K - $200K  •  0.10% - 0.50%
The fastest path to relevant recommendations and search
New York City
Full-time
6+ years
About Shaped

Shaped is the fastest path to relevant recommendation and search systems. We help companies turn their behavioral data into truly relevant product and website experiences.

We're a Series A companies based in Brooklyn, New York and backed by top investors from Madrona, Y-Combinator and executives from Meta, Google, Amazon and Uber!

About the role
Skills: Kafka, SQL, Spark, Python

We are looking for a data engineer to design, build and optimize Shaped's real-time and batch streaming infrastructure. You will be a founding engineer working to reliably ingest customer data (both with batch and real-time processing) into our our state-of-the-art AI discovery engine. As one of Shaped’s early employees you will help shape our product, culture and vision.

  • Skills should include Python, Data Warehouses (such as Clickhouse, Snowflake, or BigQuery)
  • Nice-to-have skills should include DBT, Meltano, Airflow, and Apache Flink (or other stream processing frameworks)

We’re excited to work with you. Come build the future of AI with us!

Technology

Customers typically use Shaped as follows:

  1. Connect your data stack, e.g. data warehouse, database or analytics applications
  2. Define your model. This includes your optimization objective (e.g. clicks vs purchases vs shares), item and user catalogs, feature types and model types.
  3. Consume your results from our real-time, scalable ranking endpoints
  4. Evaluate uplift and model results on our dashboard.

To power all of this, under the hood, we've built a multi-tenanted, real-time machine learning architecture which automatically sets-up and ingests data both in real-time and batch, transforms data and stores it into our proprietary feature/vector store. Ranking models are continuously optimized and fine-tuned based on real-time feedback ensuring customers are seeing the most relevant and up-to-date results possible.

From a machine-learning perspective we use state-of-the-art large scale neural encoding models to understand multi-modal data types such as image, text, audio and tabular data. We provide an exhaustive library of retrieval, ranking and ordering algorithms which are selected based on the specified model definition.

We use both AWS and GCP for cloud. Kubernetes for serverless infrastructure. Python, Javascript and Rust for languages.

Other jobs at Shaped

fulltimeNew York, NY, USData science$80K - $130K0.05% - 0.10%1+ years

fulltimeNY, USProduct design$120K - $180K0.10% - 0.30%6+ years

fulltimeNew York CityMachine learning$150K - $200K0.10% - 0.50%6+ years

fulltimeNew York, NY, USBackend$100K - $200K0.10% - 0.30%3+ years

fulltimeNY, USData science$90K - $150K0.10% - 0.30%3+ years

fulltimeNew York CityBackend$130K - $200K0.10% - 0.50%6+ years

Hundreds of YC startups are hiring on Work at a Startup.

Sign up to see more ›