[Open Source] A Streaming Application Development and Management System for Low-Cost Streaming Application R&D and Management

Open SourceProcess Management
2026-06-28 06:05 2 次浏览 • 0 次下载 0KB
[Open Source] A Streaming Application Development and Management System for Low-Cost Streaming Application R&D and Management

1. Project Overview

Streamis is a streaming application development and management system jointly developed by WeBank and Tianyi Cloud、Xianweng Technology and Samoyed Cloud .

Leveraging the framework capabilities of DataSphere Studio and its underlying integration with Linkis's Flink engine, it enables users to develop, debug, publish, and manage streaming applications in production environments at a low cost.

Future plans also include a workflow-based graphical drag-and-drop development experience, where streaming applications will be connected into a streaming workflow through Source, Dimension, Transform, Sink, and Visualis nodes. This will enable users to develop, debug, and publish streaming applications with a lower learning curve.

2. Open Source License

Licensed under Apache-2.0

3. Screenshots

Powerful Streaming Application Development and Debugging Capabilities.

Provides streaming application development and debugging features based on DSS-Scriptis, supporting real-time debugging of FlinkSQL and result set visualization.

Image

Powerful Streaming Application Production Center Capabilities.

Supports multi-version management, full-lifecycle management, monitoring and alerting, and checkpoint and savepoint management for streaming jobs.

Image

Streaming Application Runtime Status:

Image

Streaming Application Parameter Configuration:

Image
Image

4. Feature Overview

Key Features

Built on DSS and Linkis, this platform delivers a leading streaming application development and management system.

Using Flink as the underlying computing engine, it adopts an architecture that separates the Development Center from the Production Center. Development permissions are completely isolated from publishing permissions, and development environments are isolated from production environments, ensuring high stability and security for business applications.

The application development layer is seamlessly integrated with DSS's data application development workflow, providing an extremely simple user experience.

The application execution layer integrates Linkis computing middleware to provide financial-grade streaming application management capabilities, including high concurrency, high availability, multi-tenant isolation, and resource management.

For more features, please refer to: Streamis User Manual.

Streamis Feature Overview

Feature Modules

Description

Streamis

Installation and Deployment

Deployment Complexity and Third-Party Dependencies

One-click deployment, dependent on the Linkis Flink engine

Development Center

Real-time development and debugging of FlinkSQL streaming applications

Supported; DSS integration required

Production Center

Streaming application management and operations capabilities

Support

 

Reuses Linkis computing governance capabilities

Support

 

Supports publishing through FlinkSQL, FlinkJar packages, and other methods

Support

 

Multi-version management of streaming applications

Support

 

Parameter configuration and alerting for streaming applications

Support

Service High Availability

Application high availability, multi-node services, and fault tolerance through state snapshots ensure that failures do not affect usage

Support

System Management

Node and Resource Management

Support

Permission Management

Task operation permission control

Support

5. Tech Stack

Architecture

Image

Dependent Ecosystem Components

Dependent Application Tools

Description

Streamis Compatible Versions

DataSphereStudio

An integrated framework for data application development and management. It provides a workflow-based graphical drag-and-drop development experience covering the entire data application development lifecycle, including data exchange, desensitization and cleaning, analysis and mining, quality inspection, visualization, scheduled scheduling, and data output applications.

>= DSS1.1.0 (Released)

Linkis

Apache Linkis computing middleware provides standard interfaces such as REST/WebSocket/JDBC/SDK, allowing upper-layer applications to conveniently connect to and access underlying engines such as
MySQL/Spark/Hive/Presto/Flink.

>= Linkis1.1.1 (Released); some features require Linkis 1.1.2

Download

Please visit the Streamis releases page to download the compiled version or source package of Streamis.


Build and Installation

Please refer to the Streamis installation and deployment documentation to install and deploy Streamis and its dependencies.


Examples and Usage Guide

Please visit the User Documentation to learn how to get started with Streamis quickly.

#1
资源直链https://gitee.com/WeBank/Streamis
去下载
星河码客

发现和分享优质开源项目,传承互联网精神,为开发者服务。

关于本站

联系我们

微信/广告合作:ITcloub (备注星河码客)

免责声明:本站资源版权归原作者所有,仅供学习与交流。如有侵权,请通过「关于我们 - 侵权投诉」联系删除。

Powered by Nuxt · Deployed on Cloudflare