Kafka Connector

Move and translate data between Apache Kafka and any endpoint such as Modbus, Siemens S7, OPC DA, OPC UA, Allen Bradley ControlLogix, CompactLogix, GuardLogix, Micro800, MicroLogix, SLC 500, and PLC-5, MTConnect, MQTT, databases, applications, and more. The OAS Kafka IIoT connector simplifies secure, reliable data exchange across your operation.

Expand the Reach of Your Data

The OAS Kafka communication interface is both a producer and consumer to both local and cloud clusters. It’s a simple way to bring Kafka into your Industry 4.0 strategy without a heavy lift.

Publish up to 100,000 values per second to an individual topic on Apache Kafka with an easy-to-use IoT Publish feature in JSON format.

Read topic messages, process with OAS JSON handling, and transfer to PLCs and controllers.

Interface with SSLSaslSSLSaslPlaintext, and Plaintext security protocols to local and cloud servers.

Connect securely with support for SSL, SASL_SSL, SASL_PLAINTEXT, and PLAINTEXT protocols. Don’t worry if a topic isn’t already set up, OAS will create it automatically.

Key Features & Benefits

Industry 4.0 Data Sources

The Kafka IIoT interface connects with Modbus, Allen Bradley PLCs, Siemens S7 Controllers, OPC UA, OPC DA, MQTT, Sparkplug B, MTConnect, AWS IoT Core, Kafka, .NET, REST Clients, and Databases.

Easy Access Payload

The payload is in standard JSON format and is flexible to include the Value, Timestamp, and Quality of every value received.

JSON Handling

OAS effortlessly parses and constructs JSON packets with your chosen data—all without requiring any coding.

Read more about OAS JSON Handling

Live Data In Kafka

Send live data to Kafka from any connected source using the OAS Kafka IIoT data connector, with protocol conversion handled automatically behind the scenes.

JSON Payload

OAS transmits data in a standard JSON payload containing real time OAS Tag values, timestamps, and data quality. Multiple values are transferred per packet for efficiency.


Advantages

Small packet size = low overall bandwidth usage

Human-readable format making it easier to analyze and troubleshoot data, as well as import into other systems able to consume JSON data.


Store and Forward

Optionally enable the Store and Forward property in the Kafka driver interface to buffer data to disk in the event of communication loss to the Kafka cluster or from remote OAS Edge nodes. 
This maintains 100% data in case of network failure.

{
"values": [
{
"id": "Ramp",
"value": 27.0,
"quality": true,
"timestamp": "2022-10-11T11:08:47.000Z"
},
{
"id": "Random",
"value": 4.0,
"quality": true,
"timestamp": "2022-10-11T11:08:47.000Z"
},
{
"id": "Sine",
"value": 0.9781476007338057,
"quality": true,
"timestamp": "2022-10-11T11:08:47.000Z"
}
]
}

Common Use Cases

IoT Publish

Use the OAS Kafka IIoT gateway to create and send JSON packets based on events, time of day, or data changes. Add Store and Forward for extra peace of mind. Learn more.

Log Kafka Data to Databases and CSV Files

Use the OAS Data Historian to log data from Kafka into various databases, including SQL Server, Oracle, MySQL, PostgreSQL, SQLite, and others. This logging can be triggered by changes in the data, specific events, or continuously. The system also supports logging high-speed buffered data from a controller. Learn more.

Transfer Kafka Data

Easily transfer data between Kafka and various Industry 4.0 data sources using the Data Route feature. Transfers can be ongoing or triggered by specific events. Additionally, both Basic and Live Data Cloud Networking enhance this feature, allowing for seamless transfer over your local area network (LAN), wide area network (WAN), or the Internet. Learn more.

Kafka Core User Interface

Create Human Machine Interfaces (HMIs) for Kafka data using the cross-platform UIEngine without any coding required. The UIEngine features an extensive library of components that allow for drag-and-drop design, along with integrated support for Web Trend and Web Alarm products.

You can consider options such as WinForm HMI, WPF HMI, and Web HMI, as well as programmatic access through the .NET Data Connector and OAS REST API to seamlessly integrate Kafka data with your existing legacy applications. Learn more about the UIEngine

Learn how thousands of customers are using the OAS Product Platform around the globe to achieve truly open industrial automation

24/7/365
Support

Technical support available by phone, chat, and email

30+ Years
Experience

Product efficacy, market testing, and reliability

Used in 10K+
Data Servers

OAS is used in thousands of businesses worldwide

OAS Platform Features

Cross-Platform Support

The OAS Platform supports multiple operating systems and deployment options, including Windows, Linux, Docker Containers, and can even run on low-footprint devices such as a Raspberry PI 4. This is ideal for IIoT Kafka architectures that need scalability and performance.

Learn more about OAS System Requirements

Networking

OAS is an edge solution that offers flexible networking options for standalone installations, multi-tenant data aggregation, and even secure unidirectional data transport.

Learn more about OAS Networking Features

Programmatic Setup

Utilize our .NET SDK or REST API for flexible and automated setup, ensuring full integration with your asset management software. You can also import and export CSV files, which helps you work with Excel and third-party applications.

Learn more about OAS SDKs and APIs

Calculations, Time On, Counts, and Totals

Merge data from various sources like controllers, sensors, and external databases. You can perform real-time calculations, run logic checks, track time-on states, count transitions, and aggregate analog values without writing a single line of code.

Learn more about OAS Calculations

See How We Compare

The initial cost of OAS is far less than our competitors – but the savings don’t stop there. We work with OEMS and System Integrators to provide perpetual licenses with quantity discounts with flexible tag pricing and unlimited client connections.

Network Feature
OAS IoT DNA
Typical Cloud
Accurate Live Data
Unlimited Data Usage / No Fees
Data Resolution of 100 Nanoseconds
High Speed Throughput < 50 ms
No Data Loss on Network Failure

No Question Left Unanswered

We make getting started with OAS easy - Browse our extensive Knowledge Base of articles on Getting Started as well as How To content that takes you step-by-step through building a solution, and finally learn more about specific features and configurations.

Related Videos

Ready to get started? Install in 3 minutes & try OAS free for 30 days, or schedule a live interactive demo.