Full-Time Data Scraping & Lead Generation Engineer

Posted 3 weeks ago

Worldwide

Summary

DriveBuy.ai is a fast-growing automotive data platform focused on collecting, processing, and analyzing vehicle market data at scale. We build automated systems that aggregate data from multiple sources to power analytics, lead generation, and market intelligence products. We are looking for a talented, full-time Data Scraping & Lead Generation Engineer to join our team and help us expand and maintain our data acquisition infrastructure. This is a hands-on engineering role for someone who enjoys solving complex data acquisition challenges and working with modern automation technologies. Responsibilities: * Develop and maintain web scraping solutions for multiple websites and data sources. * Build scalable data extraction and transformation pipelines. * Monitor and improve scraper reliability, performance, and data quality. * Handle anti-bot protections, rate limits, and dynamic website structures. * Design systems for lead generation, enrichment, and validation. * Implement automated monitoring, alerting, and recovery mechanisms. * Troubleshoot and resolve scraping and data collection issues. * Collaborate with backend and DevOps teams to deploy and scale solutions. * Create documentation and maintain engineering best practices. Required Skills: * Strong experience with Python. * Experience with scraping frameworks such as Scrapy, Playwright, Selenium, and Requests / BeautifulSoup. * Experience working with APIs and structured data formats like JSON, XML, and CSV. * Strong understanding of HTTP, cookies, sessions, proxies, and browser automation. * Experience handling anti-bot systems and website protection mechanisms. * Knowledge of databases such as PostgreSQL, MySQL, ClickHouse, or MongoDB. * Familiarity with Linux environments and command-line tools. * Ability to write clean, maintainable, and well-documented code. Nice to Have: * Experience with distributed scraping systems. * Experience with cloud platforms such as AWS. * Knowledge of Docker and containerized deployments. * Experience with data enrichment providers and lead-generation platforms. * Familiarity with monitoring and observability tools. * Experience working with large-scale datasets. What We Offer: * Full-time remote position. * Long-term opportunity with a growing product. * Flexible working environment. * Opportunity to work on challenging large-scale data acquisition projects. * Competitive compensation based on experience. * Direct impact on product growth and technical direction.

  • More than 30 hrs/week
    Hourly
  • 6+ months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Selenium
Scrapy
Beautiful Soup
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:2 weeks ago
  • Interviewing:
    12
  • Invites sent:
    19
  • Unanswered invites:
    3
About the client
Member since Dec 7, 2024
  • United States
    Montclair9:14 PM

Explore similar jobs on Upwork

Local Lead GenerationHourly‐ Posted 2 weeks ago
Web Scraping
Data Scraping
Data Extraction
Lead Generation
Data Entry
Data Mining
Data Collection
Data Processing
Web Scraping Framework
Web Crawler Framework
Web Scraping Software
Web Scraping Plugin
Web API
Search Tool
Search Engine
Microsoft Word
Data Entry
Administrative Support
Microsoft Excel

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo