Member of Technical Staff (Web Access Engineer, Search Crawler) at Perplexity
RemoteLondonSearchFull-timePosted Nov 13, 2026
About the role
As published on Perplexity's job board.
Perplexity is hiring a Web Access Engineer for the Crawler team to build reliable fetching and rendering systems for AI-powered search. You'll work on freely available public web content, within site permissions and approved access policies, and develop the infrastructure that supplies content to downstream indexing and retrieval systems.
Your focus will be diagnosing network errors, page-loading issues, and incomplete rendering. You'll trace problems from network protocols through client-side execution, distinguish technical failures from intentional access restrictions, and turn findings into production fixes that improve content quality and efficiency at scale.
Responsibilities
- Own fetching and rendering improvements end to end, from investigation through implementation and production rollout, partnering with crawler engineers and SREs.
- Investigate fetch and rendering failures across DNS, TLS, HTTP, caching, redirects, and client-side rendering, and classify root causes.
- Improve page loading, completion detection, and content capture to preserve relevant content and handle dynamic pages reliably.
- Ensure the crawler respects site-imposed access restrictions and rate limits, identifies itself clearly, and retries only transient technical errors.
- Build tools to reproduce failures, compare crawler output against expected page content, and turn findings into regression tests.
- Define metrics for fetching reliability, content completeness, and error classification, and use them to prioritize improvements.
Qualifications
- 5+ years of software engineering experience in web infrastructure, browsers, CDNs, or crawling, with strong programming skills in at least one of Go, Python, Rust, or C++.
- Deep understanding of HTTP/1.1, HTTP/2, and HTTP/3, including status semantics, caching, conditional requests, content encoding, and redirects; strong knowledge of TLS, DNS, cookies, and sessions.
- Understanding of CDN caching and content delivery, HTTP error handling, retry backoff, and server-defined rate limits.
- Knowledge of page lifecycle, network idle, service workers, client-side rendering, and shadow DOM; experience debugging JavaScript and fluency with Chrome DevTools, CDP, HAR files, curl, and packet captures.
- Comfort working independently when the path forward is not fully defined.
Nice to have
- Experience developing CDN, caching, or web performance systems.
- Experience operating crawlers, headless browsers, or distributed content-acquisition systems at scale.
- Contributions to a browser engine or JavaScript runtime.
Similar roles at other companies
Open AI research jobs elsewhere, newest first.
| Role | Company | Salary | Posted | Actions |
|---|---|---|---|---|
| Research Operations, External Artifacts AI Research & Engineering | Anthropic | $210K–$260K | Tailor | |
| Researcher, Cyber Safety Training Research | OpenAI | $380K–$500K | Tailor | |
| Base Labs Research Scientist - RL Environments EPD | Baseten | $210–$285 | Tailor | |
| Senior User Experience Researcher Product & Design | Oscar Health | $164K–$215K | Tailor | |
| Senior User Experience Researcher Product & Design | Oscar Health | $164K–$215K | Tailor | |
| Senior User Experience Researcher Product & Design | Oscar Health | $164K–$215K | Tailor |
- Research Operations, External ArtifactsRemote$210K–$260KNov 21AI Research & Engineering
- Researcher, Cyber Safety TrainingSan Francisco$380K–$500KNov 21Research
- Base Labs Research Scientist - RL EnvironmentsRemoteSan Francisco$210–$285Nov 20EPD
- Senior User Experience ResearcherSan Francisco, CA$164K–$215KNov 20Product & Design
- Senior User Experience ResearcherBoston, MA$164K–$215KNov 20Product & Design
- Senior User Experience ResearcherLos Angeles, CA$164K–$215KNov 20Product & Design
Before you apply
- Scan your resume against this posting to see which of its terms you are missing.
- Tailor your resume so the summary and bullets use the posting's own wording where it is true for you.
- Read the research scientist resume guide and the interview questions for the role.
- Apply on Perplexity's site. Applications never pass through OneTwo Resume.
About Perplexity
AI answer engine that responds to questions with cited sources, along with the Comet browser and agent tools.
All open roles at Perplexity · All AI research jobs at AI and tech companies
More roles at Perplexity
| Role | Salary | Posted | Actions |
|---|---|---|---|
| Regional Sales Director, Legal Sales | $380K–$450K | Tailor | |
| Senior Art Director Design | $180K–$220K | Tailor | |
| Engineering Manager (Agent Verticals) AI Products | $300K–$485K | Tailor | |
| Research & Development Site Lead (London) AI Research & Systems | — | Tailor | |
| Founding Account Executive, EMEA Sales | — | Tailor | |
| Member of Technical Staff (Software Engineer, AI Policy and Strategic Initiatives) AI Research & Systems | $220K–$405K | Tailor |
- Regional Sales Director, LegalRemoteSan Francisco$380K–$450KNov 20Sales
- Senior Art DirectorSan Francisco$180K–$220KNov 20Design
- Engineering Manager (Agent Verticals)San Francisco$300K–$485KNov 20AI Products
- Research & Development Site Lead (London)LondonNov 19AI Research & Systems
- Founding Account Executive, EMEALondonNov 19Sales
- Member of Technical Staff (Software Engineer, AI Policy and Strategic Initiatives)San Francisco$220K–$405KNov 19AI Research & Systems