Scraping Tech Lead Engineer (Web scraping & Anti-bot)
Infatica.io
- Nigeria
- Permanent
- Full-time
- Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
- Control-plane: API, authorization, billing, quotas, monitoring
- Infrastructure: microservices, Docker/K8s, CI/CD, observability
- Team building: participate in hiring backend, browser, DevOps, and QA engineers
- Establish development and release processes
- Code quality control and technical decision oversight
- Browser and network-level fingerprinting (JA3, TLS, CDP)
- Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others
- CI/CD setup, Helm charts, scaling configuration
- Monitoring organization (Prometheus, Grafana, Loki) and SLA processes
- 5+ years of engineering experience in high-load backend/data platforms
- Extensive Scraping experience (mandatory)
- Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
- Experience with async Python and Go (ideally both), Redis, queues, message brokers
- Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD
- Experience analyzing and bypassing bot protection systems — strong plus
- Fluent English (all documentation and part of the team are English-speaking)
- Decision-making skills, mentoring abilities, and accountability for results
- Participate in developing the company's key product from scratch
- High autonomy and influence on architecture and team decisions
- Budget for conferences, courses, and work tools
- Competitive compensation package
- Remote work flexibility