Skip to main content

Company / Careers / Engineering

Crawling Engineer

OpenCrawlingBucharestHybrid

You design and scale the systems that turn the open web into structured data: distributed crawlers running thousands of workers at once, holding throughput and freshness at the scale the whole graph depends on. The web is messy, uneven, and never holds still, and your systems have to hold anyway.

All open roles
Full disclosure

The way we work is not for everyone, and that's fine. We'd rather you know now than three interviews in. We dislike every side of micromanagement, so no one will hand you a detailed plan. You'll own things before you feel ready and the pace doesn't ease up.

If this sounds frustrating, trust that feeling. If it sounds like your kind of place, let's talk.

Who we are

  • A deeptech startup of 60 people in Bucharest, building the machine that reads the company world.
  • Our customers include the giants of the data world, the same companies you'd expect to be our competitors.
  • Founded in 2019, VC-backed. The team stays small on purpose, so decisions stay with the person doing the work.
  • Most of the team is technical, founders included. The decisions that shape the company are made by people who understand the low-level work behind it.
  • What we run in-house (from our crawlers to our own LLMs) is what several entire companies get built around. Here it's only one team.

Who you are

  • You own your work like a founder owns a product.
  • A growth mindset, able to capitalize on unprecedented contexts through your skills and abilities.
  • A strong problem solver, visible in the way you deal with the tension between brief and shipping.
  • Resilient, especially in front of failure, the kind that always comes paired with pioneering work.
  • An appetite to grapple with a variety of technical challenges.

What we do

  • Crawl the entire internet and decide, page by page, what matters.
  • Interpret everything we find with LLMs we train ourselves, in 125 languages.
  • Resolve every source under the company it belongs to, in one living graph of 135M+ companies.
  • Trace every datapoint back to the source it came from, so every judgment can be defended.
  • Keep the history, so we notice when any one of them changes.

What you'll do

  • Design and maintain the distributed crawling infrastructure that turns the open web into structured input for the rest of the pipeline.
  • Build large-scale extraction pipelines that hold up against the vast, unstructured web.
  • Optimize throughput, latency, and resource use across thousands of concurrent agents.
  • Instrument every agent with structured logs, metrics, and tracing, so a drop in coverage is caught and traced before it costs the graph.
  • Find the inefficiencies and breakages and proactively improve coverage, stability, and speed.

What you'll find here

  • Founders who built products serving billions of users, across web, big data, and cloud.
  • Infrastructure most companies rent, built and run in-house: crawlers, GPUs, custom LLMs.
  • Scale you'd otherwise wait a career to touch: 4.2B pages a month, 3M tokens a second, from day one.
  • Problems no one has solved before, some so far out that academic papers are the only formal guide we have.
  • Five disciplines under one roof (crawling, ML, big data, infrastructure, product) close enough that you see how all of them actually work.

What we look for

  • Strong programming skills; you'll work in Node.js with TypeScript, and Scala.
  • A good understanding of building resilient, observable distributed systems or large-scale crawlers.
  • Experience with Puppeteer, Playwright, and HTML parsers.
  • Knowledge of performance profiling, system bottlenecks, and resource constraints in long-running agents.
  • Familiarity with container orchestration such as Kubernetes.

What we offer

  • Fair, market-aligned base, ESOP tied to impact (for permanent roles), and a high salary growth rate tied to performance.
  • Decisions that would need three approvals elsewhere are yours to make, and yours to answer for.
  • Growth at the pace you can take, and responsibility that expands as fast as you prove you can hold it.
  • What you build lands in front of some of the largest companies in the world, often within weeks.
  • Steep learning curve, no matter how experienced you are, with people who've climbed it a desk away when you're stuck.

What we expect in return

  • High tolerance for ambiguity, marked by your ambition to push forward with incomplete information.
  • High speed and uncompromising quality in your work.
  • The ability to quickly and effectively evaluate technical tradeoffs and translate them into relevant scenarios
  • Genuine aversion to any customer or colleague struggling with something you delivered.
  • Ask what would make it ten times better, starting with your own work.

How we hire

A process built to help both of us decide.

We keep it informal because that's how we actually work. And we take it seriously because one hire can change a company this size. The way we communicate throughout is designed so that either of us can openly say it isn't working, even mid-interview.

  1. 1
    Home Assignment
    A hands-on problem cut from the real work of this role. You'll know what the job is like before you say yes to it, and so will we.
  2. 2
    Team interviews
    Sessions with the people you would actually work beside, one of which is face-to-face and includes live tasks.
  3. 3
    Decision
    A yes or a no, typically fast. We do not ghost.

Careers

Recognize yourself in all of this?

Send your application and a note on why this role fits. We read every one, and if it matches what we're looking for, you'll hear from us.

All open roles