A leading Health-Tech startup is developing a next-generation Azure-native data platform to power AI-driven digital healthcare experiences. The platform supports existing telemedicine and telehealth applications while re-imagining data, analytics, and AI foundations for scale, quality, and speed.
Role Overview
We’re seeking a Senior Streaming Data Engineer to design and implement real-time ingestion and processing frameworks using Azure Event Hubs or Service Bus. You’ll build robust, low-latency pipelines that deliver reliable data for near-real-time analytics, driving operational insight and intelligent automation across the platform.
Key Responsibilities
• Develop and optimize event-streaming pipelines and stateful processors for real-time ingestion and transformation.
• Implement checkpointing, replay, and dead-letter strategies to ensure fault tolerance and observability.
• Design and maintain autoscaling, partition management, and health monitoring for streaming workloads.
• Build near-real-time views and curated data products supporting analytics and AI.
• Collaborate with the batch ingestion team to reconcile late or changed data and align Slowly Changing Dimensions (SCD) logic.
Key Outcomes
• Reliable Event Hubs ingestion with checkpointing, replay, and backpressure control.
• Fully monitored pipelines with defined SLAs and sub-60-second end-to-end latency.
• Consistent real-time views feeding analytics and ML models.
Requirements
📍 Location: Providencia, Guadalajara, Mexico
🗣️ Language: Bilingual (English & Spanish)
💼 Must be legally authorized to work and currently residing in Mexico.
⌚Full-Time | U.S. Eastern Time
Qualifications
• 5+ years in data engineering, including 2+ years working with event streaming (Azure Event Hubs, Service Bus, or Kafka).
• Strong experience with Spark Structured Streaming, Flink, or similar.
• Advanced proficiency in Python or Scala.
• Deep understanding of idempotent processing, at-least/exactly-once semantics, and real-time data architectures.
Benefits
At Meztal, we prioritize innovation, collaboration, and personal growth. You’ll have the opportunity to work on meaningful projects, be part of a supportive team, and enjoy a culture that values work-life balance and professional development.