Skip to content

Releases: devlive-community/datacap

2025.1.1

28 Jul 06:22
36a1d60
Compare
Choose a tag to compare

我们很高兴地宣布 DataCap 2025.1.1 版本正式发布!本次更新专注于提升系统稳定性、修复关键问题,并新增了多项实用功能。

📅 发布信息

🎯 版本亮点

🆕 新功能特性

  • 🐬 DolphinDB 数据库支持: 全新支持 DolphinDB 时序数据库,扩展了高性能时间序列数据处理能力
  • 📊 数据集通知系统: 新增数据集通知配置功能,支持自定义通知规则和异步任务处理
  • 🔧 Flink SQL 解析器: 增强了 SQL 解析能力,现已支持 Flink SQL 语法解析
  • 📱 多 SQL 语句支持: 优化解析器,支持在单次操作中处理多条 SQL 语句
  • 🔌 插件详情展示: 改进插件商店界面,提供更详细的插件信息展示

🛠️ 重要修复

  • 数据导出格式化: 修复了数据导出时未指定格式化的问题,确保导出数据的正确性
  • Doris 插件优化: 解决了 Doris 插件在渲染数据库名称时的显示异常 (#943)
  • 分页国际化: 完善了分页组件的多语言支持,提升用户体验
  • JSON 转换精度: 修复了 JSON 转换过程中 LocalDateTime 丢失秒精度的问题 (#920)
  • 数据重复问题: 解决了数据集执行后可能导致数据重复的问题
  • 用户密码安全: 修复了管理员修改用户密码时可能导致密码明文存储的安全隐患

🔧 系统优化

  • 达梦数据库增强: 改进了达梦数据库连接器的兼容性,解决了 Docker 平台兼容性问题
  • 通知中心升级: 优化了通知中心的界面和功能,提供更好的消息管理体验
  • 代码质量提升: 修复了多个静态代码分析发现的潜在问题,提高了代码稳定性
  • Docker 镜像优化: 支持构建多平台 Docker 镜像,提升部署灵活性

🗑️ 功能移除

  • Pipeline 功能清理: 移除了 Pipeline 相关功能及代码,简化了系统架构
  • 无效组件清理: 清理了未使用的属性和无效配置,优化了系统性能

🚀 升级指南

  1. 备份数据: 升级前请务必备份您的数据和配置文件
  2. 停止服务: 停止当前运行的 DataCap 服务
  3. 更新版本: 下载最新的 2025.1.1 版本文件
  4. 数据库升级: 如有数据库结构变更,请参考升级脚本
  5. 重启服务: 启动新版本服务并验证功能

📝 注意事项

  • 本版本移除了 Pipeline 功能,如果您在使用相关功能,请在升级前做好数据迁移
  • 新增的 DolphinDB 支持需要相应的插件配置
  • 建议在生产环境升级前,先在测试环境进行完整验证

🤝 致谢

感谢所有为本版本贡献代码和反馈的开发者和用户,特别感谢:

  • qianmoQ - 主要开发贡献
  • Max Xie - SR & Doris 插件支持
  • AllData数据中台创始人 & CTO - 配置优化
  • zhanggaopan - 文档改进

📞 获取支持

如果您在使用过程中遇到任何问题,请通过以下方式获取帮助:


DataCap 团队将持续致力于为用户提供更稳定、更强大的数据处理平台。感谢您的支持与信任!

2025.1.0

02 Mar 12:23
2f9d545
Compare
Choose a tag to compare

Dear DataCap Users,

We are delighted to announce the official release of DataCap 2025.1.0! This update introduces a brand-new notification center, enhances metadata management capabilities, and fixes multiple known issues, further improving the software's stability and user experience.

Release Highlights

🔔 New Notification Center

  • Added a complete notification system architecture to help users receive important updates and alerts
  • Implemented dataset update notifications to keep teams informed about data changes
  • Optimized notification plugin SPI interface for easier developer extensions
  • Added notification pagination configuration and empty data prompts for better user experience

📊 Dataset Enhancements

  • Added support for dataset deletion (closing issue #904)
  • Fixed ad-hoc query sorting issues to improve data query efficiency
  • Fixed content population issues in the query page builder
  • Resolved dataset startup failure problems

💻 ClickHouse Compatibility Improvements

  • Adapted metadata management functionality for better compatibility
  • Fixed column conversion build issues
  • Removed invalid function menus for a streamlined interface

🔧 System Optimizations

  • Improved user avatar upload logic
  • Fixed editor configuration save failure issues
  • Resolved Docker image build problems
  • Optimized pagination data retrieval methods
  • Added auto-suggestion functionality

📋 Documentation Updates

  • Completely restructured development documentation, changelog, connector documentation, and system documentation
  • Refactored management documentation, workflow documentation, and dataset documentation
  • Enhanced overall system documentation

🖼️ Interface Improvements

  • Fixed dashboard image display and upload path issues
  • Resolved visualization type splitting problems
  • Fixed menu layout anomalies
  • Removed invalid menu items

🔍 Metadata Management Reconstruction

  • Refactored metadata retrieval methods for improved performance
  • Optimized database, table, and column retrieval approaches
  • Enhanced data CRUD operations
  • Added support for engines and data types

How to Get It

GitHub Download

You can get the latest version from our GitHub repository:
https://github.com/devlive-community/datacap

Official Website

Visit our official website for more information:
https://datacap.devlive.org/

Acknowledgments

We would like to thank all developers and users who have contributed to DataCap. Your support and feedback are the driving force behind our continuous improvement. We will continue our efforts to provide you with better data transformation, integration, and visualization experiences.

If you encounter any issues during use or have any suggestions, please contact us through GitHub Issues.

The DataCap Team
March 2, 2025

2024.4.1

31 Dec 03:21
e30f5df
Compare
Choose a tag to compare

DataCap Released!

Release Version Published
2024.4.1 2024-12-31

Dear DataCap users,

DataCap 2024.4.1 is now generally available. This update includes a number of important feature upgrades and performance improvements, and the main updates are as follows:

Core function upgrades

  1. Database Enhancements (Implementations)

    • Added database management feature: You can create, delete, and switch databases
    • Improved table management features: You can create, delete, and insert data
  2. MongoDB driver upgrade

    • Optimize query performance: Replace find with aggregate
    • Added metadata support
    • Supports com.dbschema.MongoJdbcDriver adaptation
    • Improve version control and index fetching functions
  3. Workflow Engine Optimization

    • Added workflow task submission feature
    • Workflow restart operations are supported
    • Optimized the SeatTunnel executor to support custom node types
  4. SQL parser enhancements

    • Optimized the structure of G4 expressions
    • Added support for SHOW statements
    • Improve the formatting function of SELECT statements
    • Support for CREATE DATABASE syntax

Bug fixes

  • Fixed the issue of creating query history
  • Fixed the JSON conversion issue of the LocalDateTime type
  • The issue of historical data acquisition failure is fixed
  • Optimized the acquisition of the Dameng database plug-in version

Other optimizations

  • Improved Windows platform support
  • Optimized release scripts
  • Optimize your CI/CD process

How to get it

Thank you to the community for your continued support and feedback. If you have questions or suggestions, please feel free to contact us via GitHub Issues.

2024.4.0

02 Dec 09:40
34f1820
Compare
Choose a tag to compare

DataCap Released!

Release Version Published
2024.4 2024-12-02

!!! note

This is a brand new version that uses a new plugin management system, new APIs, and other new features. This update is a new version and is not compatible with the previous version. Make a backup of your data before upgrading to avoid data loss. The database is compatible, as long as the upgraded SQL is executed.

Key features


  • Fixed the issue that the internationalization acquisition failed due to login
  • Split the plug-in system into a new module to support better plug-in management
  • Support online installation, uninstallation and other operations of plug-ins
  • Added a general test module
  • Added a brand new plugin store
  • Fixed the issue that an exception occurred when saving a dataset
  • Use the new 'JsonView' annotation for better data security and display

documentation


  • Added Open API documentation

2024.3.11

17 Nov 14:56
fe09727
Compare
Choose a tag to compare

DataCap Released!

Release Version Published Date
2024.3.11 2024-11-17

Key features


  • Fixed some APIs returning redundant fields
  • Added a Clear UI dependency script
  • Replace yarn with pnpm
  • Fixed an issue where the Parent Menu was missing when only Submenu was assigned

UI


  • Replace the overall UI with 'view-shadcn-ui'

2024.3.10

09 Oct 07:17
1d6be5c
Compare
Choose a tag to compare

DataCap 发布!

发布版本 发布时间
2024.3.10 2024-10-09

主要功能


  • 移除示例地址
  • 修复登录页面上的验证码问题
  • 修复注册页面上的验证码问题
  • 修复验证码验证规则
  • 修复文档指定 Java 版本

文件系统


  • 支持 MinIO

依赖更新


  • Bump dep.antlr4.version from 4.13.1 to 4.13.2
  • Bump ag-grid-community and ag-grid-vue3
  • Bump commons-io:commons-io from 2.11.0 to 2.14.0
  • Bump com.clickhouse:clickhouse-jdbc from 0.4.6 to 0.6.5
  • Bump vite from 5.2.8 to 5.4.8
  • Bump rollup from 4.14.2 to 4.22.4
  • Bump micromatch from 4.0.5 to 4.0.8
  • Bump axios from 1.6.8 to 1.7.4
  • Bump org.yaml:snakeyaml from 2.2 to 2.3
  • Bump com.github.vertical-blank:sql-formatter from 2.0.3 to 2.0.5
  • Bump org.apache.maven.plugins:maven-javadoc-plugin from 3.8.0 to 3.10.0
  • Bump com.amazonaws:aws-java-sdk-s3 from 1.12.770 to 1.12.771
  • Bump org.testcontainers:oracle-xe from 1.18.1 to 1.20.1
  • Bump com.github.eirslett:frontend-maven-plugin from 1.13.4 to 1.15.0
  • Bump kotlin.version from 1.9.10 to 2.0.20
  • Bump org.duckdb:duckdb_jdbc from 0.9.2 to 1.0.0
  • Bump com.taosdata.jdbc:taos-jdbcdriver from 3.2.7 to 3.3.0
  • Bump com.microsoft.sqlserver:mssql-jdbc from 12.6.0.jre8 to 12.8.1.jre8
  • Bump avatica.version from 1.22.0 to 1.25.0
  • Bump org.apache.iotdb:iotdb-jdbc from 1.1.0 to 1.3.2

2024.03.9

27 Aug 13:51
251b5c0
Compare
Choose a tag to compare

DataCap 发布!

发布版本 发布时间
2024.03.9 2024-08-27

主要功能


  • 修复 maven 发布 CI
  • 修复包缺少文件导致启动失败的问题
  • 修复构建数据集不携带查询 SQL 的问题
  • 修复数据集未携带 injector 导致构建失败的问题

文件系统


  • 支持腾讯 COS
  • 支持 Amazon S3

依赖


  • 升级 UI braces 3.0.23.0.3
  • 升级 org.apache.kyuubi:kyuubi-hive-jdbc-shaded 1.7.11.9.2
  • 升级 org.apache.maven.plugins:maven-compiler-plugin 3.12.13.13.0
  • 升级 testcontainers.version 1.19.51.20.1
  • 升级 org.apache.maven.plugins:maven-javadoc-plugin 3.6.33.8.0
  • 升级 jackson.version 2.17.02.17.2
  • 升级 org.elasticsearch.plugin:x-pack-sql-jdbc 8.12.08.15.0
  • 升级 org.apache.commons:commons-csv 1.10.01.11.0
  • 升级 monetdb:monetdb-jdbc 3.211.19.15

2024.03.8

29 Jul 08:27
4c48449
Compare
Choose a tag to compare

DataCap 发布!

发布版本 发布时间
2024.03.8 2024-07-29

主要功能


  • 优化核心打包方式

执行器


  • 优化打包方式为按需加载

插件


  • 优化打包方式为按需加载

转换器


  • 优化打包方式为按需加载

依赖


  • 升级 net.snowflake:snowflake-jdbc 3.14.43.17.0
  • 升级 com.dameng:DmJdbcDriver18 8.1.3.628.1.3.140
  • 升级 hadoop.version 3.3.43.4.0
  • 升级 org.apache.pinot:pinot-jdbc-client 0.8.01.1.0
  • 升级 org.apache.phoenix:phoenix-core 4.16.05.2.0
  • 升级 jackson.version 2.16.12.17.0

2024.03.7

02 Jul 15:50
bc7f2a2
Compare
Choose a tag to compare

DataCap 发布!

发布版本 发布时间
2024.03.7 2024-07-02

主要功能


  • 重新布局 README.md 连接器列表
  • 支持 Banner 显示应用信息

插件


  • 支持 Apache Solr
  • 支持 InfluxDB
  • 重命名 ScyllaDB 包名
  • 修复 SPI 异常连接未被拦截的问题

转换器


  • 重命名 fileconvert
  • 支持 xml 转换器

依赖


  • 升级 io.trino:trino-jdbc 414 至 450

2024.03.6

19 Jun 12:55
e310de8
Compare
Choose a tag to compare

DataCap 发布!

发布版本 发布时间
2024.03.6 2024-06-19

主要功能


  • 替换 findbugsspotbugs
  • 修复 JwtResponse 返回问题
  • 适配数据源元数据
  • 适配元数据转换器

文档


  • 添加通知器文档
  • 添加转换器文档

转换器


  • 支持 Json
  • 支持 Txt
  • 支持 Csv
  • 支持 None