Messaging Engineer (Real-Time Data Exchange)

The Messaging Engineer is responsible for designing, deploying, and maintaining the messaging infrastructure that enables real-time data exchange across factory automation systems, MES platforms, and enterprise IT systems. This role focuses on high-throughput, low-latency streaming architectures to ensure reliable event-driven communication in a high-volume manufacturing environment.

Key Responsibilities

• Design, implement, and maintain messaging infrastructure supporting real-time factory data exchange

• Deploy and manage distributed message brokers such as Apache Kafka or MQTT-based systems

• Enable streaming communication between shop-floor equipment, sensors, MES, and enterprise platforms

• Define and govern message topics, channels, and data schemas for consistent event structures

• Optimize messaging pipelines for low latency, high throughput, and fault tolerance

• Ensure reliable delivery of critical events without data loss or duplication

• Implement monitoring and alerting for messaging systems, tracking throughput, lag, and error rates

• Troubleshoot and resolve messaging pipeline issues quickly to maintain production stability

• Collaborate with application developers to integrate systems with the messaging layer

• Tune producer and consumer performance to meet factory throughput demands

• Maintain documentation for messaging architecture, configurations, and operational procedures

Requirements / Qualifications

• Bachelor’s Degree in Computer Science, Software Engineering, IT, or related field

• Minimum 3 years of experience working with messaging or streaming platforms in production environments

• Strong understanding of event-driven architectures and real-time data pipelines

Must Have Skills

• Hands-on experience with message-oriented middleware or streaming platforms

• Proven experience deploying or managing Apache Kafka (preferred) or similar systems

• Knowledge of topic design, partitioning, replication, and broker configuration

• Experience building pub/sub data pipelines with high throughput and fault tolerance

• Strong programming skills in Java, Scala, or Python for producer/consumer development

• Understanding of messaging internals such as consumer groups, offsets, and retention policies

Good to Have Skills

• Experience with industrial or IoT messaging (MQTT, AMQP)

• Knowledge of data serialization and schema management (Avro, Protobuf, Schema Registry)

• Experience with monitoring and observability tools (Prometheus, Grafana, cloud monitoring)

• Familiarity with event-driven microservices and factory IT landscapes (MES, databases, analytics)