[Open Source] A Streaming Application Development and Management System for Low-Cost Streaming Application R&D and Management
![[Open Source] A Streaming Application Development and Management System for Low-Cost Streaming Application R&D and Management](https://yy123.ink/api/img/1782597926414-an48lo.jpg)
1. Project Overview
Streamis is a streaming application development and management system jointly developed by WeBank and Tianyi Cloud、Xianweng Technology and Samoyed Cloud .
Leveraging the framework capabilities of DataSphere Studio and its underlying integration with Linkis's Flink engine, it enables users to develop, debug, publish, and manage streaming applications in production environments at a low cost.
Future plans also include a workflow-based graphical drag-and-drop development experience, where streaming applications will be connected into a streaming workflow through Source, Dimension, Transform, Sink, and Visualis nodes. This will enable users to develop, debug, and publish streaming applications with a lower learning curve.
2. Open Source License
Licensed under Apache-2.0
3. Screenshots
Powerful Streaming Application Development and Debugging Capabilities.
Provides streaming application development and debugging features based on DSS-Scriptis, supporting real-time debugging of FlinkSQL and result set visualization.

Powerful Streaming Application Production Center Capabilities.
Supports multi-version management, full-lifecycle management, monitoring and alerting, and checkpoint and savepoint management for streaming jobs.

Streaming Application Runtime Status:

Streaming Application Parameter Configuration:


4. Feature Overview
Key Features
Built on DSS and Linkis, this platform delivers a leading streaming application development and management system.
Using Flink as the underlying computing engine, it adopts an architecture that separates the Development Center from the Production Center. Development permissions are completely isolated from publishing permissions, and development environments are isolated from production environments, ensuring high stability and security for business applications.
The application development layer is seamlessly integrated with DSS's data application development workflow, providing an extremely simple user experience.
The application execution layer integrates Linkis computing middleware to provide financial-grade streaming application management capabilities, including high concurrency, high availability, multi-tenant isolation, and resource management.
For more features, please refer to: Streamis User Manual.
Streamis Feature Overview
|
Feature Modules |
Description |
Streamis |
|
Installation and Deployment |
Deployment Complexity and Third-Party Dependencies |
One-click deployment, dependent on the Linkis Flink engine |
|
Development Center |
Real-time development and debugging of FlinkSQL streaming applications |
Supported; DSS integration required |
|
Production Center |
Streaming application management and operations capabilities |
Support |
|
|
Reuses Linkis computing governance capabilities |
Support |
|
|
Supports publishing through FlinkSQL, FlinkJar packages, and other methods |
Support |
|
|
Multi-version management of streaming applications |
Support |
|
|
Parameter configuration and alerting for streaming applications |
Support |
|
Service High Availability |
Application high availability, multi-node services, and fault tolerance through state snapshots ensure that failures do not affect usage |
Support |
|
System Management |
Node and Resource Management |
Support |
|
Permission Management |
Task operation permission control |
Support |
5. Tech Stack
Architecture

Dependent Ecosystem Components
|
Dependent Application Tools |
Description |
Streamis Compatible Versions |
|
DataSphereStudio |
An integrated framework for data application development and management. It provides a workflow-based graphical drag-and-drop development experience covering the entire data application development lifecycle, including data exchange, desensitization and cleaning, analysis and mining, quality inspection, visualization, scheduled scheduling, and data output applications. |
>= DSS1.1.0 (Released) |
|
Linkis |
Apache Linkis computing middleware provides standard interfaces such as REST/WebSocket/JDBC/SDK, allowing upper-layer applications to conveniently connect to and access underlying engines such as |
>= Linkis1.1.1 (Released); some features require Linkis 1.1.2 |
Download
Please visit the Streamis releases page to download the compiled version or source package of Streamis.
Build and Installation
Please refer to the Streamis installation and deployment documentation to install and deploy Streamis and its dependencies.
Examples and Usage Guide
Please visit the User Documentation to learn how to get started with Streamis quickly.