Data Engineer (Web Scraping & Data Ingestion)

Added
8 days ago
Type
Full time
Salary
Salary not provided

Related skills

etl web scraping data ingestion

Do work that matters.

AtAlertMedia, everything we do supports our mission:

To save lives and minimize loss byidentifyingactive threats globally andfacilitatingtimelycommunications when an emergency threatens personal safety and business continuity. 

Our core values drive us in our important mission of keeping people safe& informed:

  • We’rehumans not robots

  • Customers always come first

  • We work better together

  • Simplicity is our strength

  • Our reputation is priceless

  • Hard work pays off

As one of the fastest growing

software

 companies in the nation,

we’re

focused on finding the best talent and building the best team to continue accelerating our rapid growth to keep up with our demand.

AlertMediais looking for an experienced Data Engineer with a strong background in web scraping, data ingestion, and large-scale data pipelines. This role is a hands-on opportunity to lead the design, maintenance, optimization, and expansion of pipelines that ingest data from open-source data sources and social media platforms at scale.

You’llplay a critical role in howAlertMediadiscovers, processes, and delivers real-time signals to customers.We’relooking for someone withdemonstratedexperience in production-grade scraping and data engineering, who is comfortable owning complex systems end to end and improving them over time.

We want you to shine by showing us real workyou’reproud of - systemsyou’vebuilt, pipelinesyou’vescaled, and hard problemsyou’vesolved. Wedon’tdo trick questions or whiteboard exercises.

Who you are:

  

You are a pragmatic data engineer who thrives in a collaborative environment and enjoys working on systems thatoperateat scale in the real world. You havesignificant experiencebuilding andmaintainingweb scraping and data ingestion pipelines, and you understand the challenges of reliability, data quality, rate limits, schema drift, and adversarial environments.

You care deeply about:

  • Building resilient, observable, and scalable data systems

  • Writing clean, maintainable code

  • Data correctness and pipeline reliability

  • Collaborating across engineering, product, and intelligence teams

You are comfortable working primarily in Python, have experience with cloud infrastructure (AWS), and are eager to continuously improve both systems and processes.

What you get to every day: 

  • Lead and own web scraping and data ingestion pipelines sourcing data from open-source datasets and social media platforms

  • Design, build, andmaintainscalable ETL and data processing pipelines (batch and/or streaming)

  • Optimizeexisting scraping infrastructure for performance, reliability, and cost

  • Handle challenges such as anti-bot protections, rate limiting, schema changes, and data quality issues

  • Build andmaintainingestion pipelines that feed downstream systems such as Elasticsearch and other data stores

  • Collaborate closely with product, intelligence, and platform teams to ensure data meets customer and business needs

  • Operate in an Agile environment using tools like Git, JIRA, Jenkins, and Slack

  • Contribute ideas and improvements that advanceAlertMedia’stechnical leadership in data-driven threat and risk intelligence

  • Help shape best practices around monitoring, alerting, testing, and documentation for data pipelines

  • Contribute toAlertMedia’sculture, values, and long-term technical vision

Whatyoubring to therole:

  • Bachelor’s degree in Computer Science, Engineering, or a related technical field (preferred)

  • 4–6+ years ofdemonstratedexperience in data engineering or backend engineering roles

  • Significant, hands-on experience with web scraping in production, including large-scale or high-reliability systems

  • Strongproficiencyin Python for data ingestion, scraping, and pipeline development

  • Experience building and operating ETL pipelines, including data validation and transformation

  • Experience with stream processing and/or event-driven architectures (Kafka, Kinesis, SQS, etc.) is a strong plus

  • Experience working with Elasticsearch or similar search/data indexing systems

  • Solid understanding of databases and data storage systems (Postgres, Redis, or similar)

  • Experience with AWS or other cloud platforms (required)

  • Strong organizational skills and ability to manage multiple pipelines and priorities

  • Excellent written and verbal communication skills, with the ability to collaborate cross-functionally

  • Ability and desire to work in a fast-paced, technically challenging environment

  • Englishproficiency(written and oral) isrequired

Whyyou’lllove working atAlertMedia:

  • Competitive Base Salary

  • Annual Company Bonus

  • 100% Employer-Paid Medical, Dental, and Vision Coverage

  • Parental Leave Program 

  • Christmas Bonus (Aguinaldo)

  • Generous Vacation and Holiday Policy

  • Monthly Work-from-Home Stipend

  • All Necessary Equipment Provided: Laptop,monitorand accessories

  • Recognition & Rewards: We celebrate wins big and small

  • Language Immersion Program with employees spread out across the globe (English, Spanish, etc...dependingon your interest)

  • Continuous Learning & Growth: From mentorship and tech talks to personalized 1:1 career development sessions,we’redeeply committed to investing in your professional journey

  • Award Winning Culture: We’repassionate about the meaningful work we do—and even more grateful for the incredible people we get to do it with!

AboutAlertMedia:

AlertMedia, backed by Vista Equity Partners, helps organizations protect their people and businesses through all phases of an emergency. Our award-winning threat intelligence, emergency communication, and travel risk management solutions help companies of all sizesidentify, respond to, and recover from critical events faster and more confidently.AlertMediasupports essential communication for thousands of leading businesses—including JetBlue, Coca-Cola Bottling, and Walmart—in more than 150 countries.

We are an equal opportunity employer focused on creating a collaborative and exciting place for all to work. Ensuring a diverse, inclusive, andequitableworkplace for all people is key to our success andcore to ourvalues.   All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. 

This is an amazing opportunity to be part of our wave of momentum and take our company, and your career, to the next growth stage.We'dlove to get to know you better and share how we serve our amazing customers. For more information, please visit

www.alertmedia.com

.   

Come join us in our mission to save lives and minimize loss through effective communication.  

AlertMediadoesnotsponsor.

By applying for the role, you agree that Alert Media will use your Personal Information in connection with the recruitment process andin accordance withour Privacy Policy –

https://www.alertmedia.com/legal/privacy-policy/

Share job

Meet JobCopilot: Your Personal AI Job Hunter

Automatically Apply to Data Jobs. Just set your preferences and Job Copilot will do the rest — finding, filtering, and applying while you focus on what matters.

Related Data Jobs

See more Data jobs →