NOTE: This is an experimental extension that is used to validate conceptual questions. It is not part of the official Eclipse Tractus-X connector offering.
The Kafka Extension integrates Apache Kafka with the Eclipse Dataspace Connector to enable continuous, event-driven data exchange in the Catena-X ecosystem. It provides a secure and controlled way to stream data between organizations while maintaining data sovereignty.
- Real-time Data Streaming: Enable continuous data exchange using Kafka's publish/subscribe model
- Secure Access Control: Dynamic credential provisioning and token-based authentication
- EDC Integration: Seamless integration with the Eclipse Dataspace Connector framework
- Data Sovereignty: Maintain control over data sharing with policy-based access control
- Standardized Protocol: Leverage the widely-adopted Kafka protocol for data streaming
This extension is particularly valuable for use cases requiring real-time data exchange, such as:
- Quality Management: Predictive maintenance and early warning notification
- Demand & Capacity Management: Real-time planning and coordination
- Digital Twin / Asset Administration Shell: Real-time operational monitoring and shopfloor efficiency
- Traceability: Event-driven tracking of part movements
- Circular Economy / Product Pass: Lifecycle event streaming
- ESG-Monitoring: Real-time environmental data collection
The project is organized into the following main directories:
-
poc: Contains the Proof of Concept implementation
kafka-pull: Core extension modules for Kafka integrationruntimes: Example implementations and test setups
-
docs: Documentation
architecture: Architecture and design documentsadministration: Administration documentation
- poc README: Instructions for running the Proof of Concept implementation
- Documentation Overview: Central hub for all documentation
- Admin Manual: How to set up, configure, and maintain the Kafka extension
- Solution Design: Detailed architecture and design of the Kafka extension
- Kafka Broker Extension: Technical details of the extension implementation
To quickly try out the Kafka extension:
- Clone this repository
- Follow the installation instructions to run the example
- Use the provided Bruno collection to test the data exchange workflow
See the Changelog for details about the changes in each release.
See CONTRIBUTING for details on how to contribute to this project.
For used licenses, please see the NOTICE.