{
    "componentChunkName": "component---src-templates-case-study-detail-ts",
    "path": "/case-studies/14",
    "result": {"pageContext":{"next":{"id":11,"attributes":{"feature":false,"title":"The SphereEx-Console Enterprise Grade Data Governance Platform is Officially Released","content":">On January 27th, SphereEx officially launched SphereEx-Console, a data monitoring and management platform. It provides a one-stop solution incorporating Apache ShardingSphere and SphereEx as the core, a powerful user interface to manage data clusters, and a platform to simplify user configuration.\n>\n>By simplifying operation & deployment processes, reducing entry barriers and data management challenges, SphereEx-Console improves enterprise operations and maintenance efficiency. \n\n\nExpanding data volumes and increasingly demanding agility requirements from front-end businesses have created significant challenges for enterprises in the finance, government and traditional manufacturing sectors. \n\nImproving underlying data architectures' adaptability, and upgrading it to a distributed ecosystem represent some of the new requirements - however, traditional centralized databases are inherently inadequate in terms of massive data carrying capacity. \n\nAs a result, distributed databases have emerged in recent years to meet this demand. Nevertheless, the complexity of distributed architectures poses great challenges to users. Simplifying users' experience has become a key database industry driver.\n\nAs a popular open source project, Apache ShardingSphere has successfully been implemented in multiple production scenarios, with an increasing number of enterprises adopting the Database Plus approach to transition from traditional relational databases to distributed databases. \n\nBased on Apache ShardingSphere a data platform on top of the existing databases is built, enabling distributed data capability to be deployed in the middle layer without requiring adjustments to the underlying data architecture. This approach allows enterprises to smoothly transition to distributed and cloud based platforms.\n\nThe SphereEx Enterprise Data Service Platform was created by leveraging ShardingSphere's open source kernel, and enhancing it with enterprise grade features. It provides improved data service capabilities, such as data sharding, data security etc.\n\n**SphereEx-Console is a powerful dashboard applied to the management and control of the SphereEx Enterprise Data Service Platform. It provides a one-stop solution with a user-friendly experience packaging resources, instances and plugins.**\n\nIt provides a visual approach to manage data clusters with Apache ShardingSphere and SphereEx as the core, while offering a platform to simplify user configuration, and ultimately improve enterprise operations & maintenance efficiency.\n\n## What is SphereEx-Console?\n\nThe SphereEx Enterprise Data Service Platform was created by leveraging ShardnginSphere's open source kernel, and enhancing it with enterprise grade features. It provides improved data service capabilities, such as data sharding, data security etc.\n\nSphereEx-Console is a powerful dashboard applied to the management and control of the SphereEx Enterprise Data Service Platform. It provides a one-stop solution with a user-friendly experience packaging multiple functions such as resource layer, instance layer and application layer.\n\nThe SphereEx-Console is used to manage the operation and maintenance of SphereEx Enterprise Data Service Platform. It supports operation, maintenance and development scenarios in Internet, finance and government industries.\n\nAs a SphereEx business data services cluster platform with ShardingSphere at its core, the SphereEx-Console visual data control platform provides a one-stop solution with a user friendly interface instead of complex code input, packaged with various features for the resource, instance and application layers. \n\n![Diagram Console EN.png](https://official-media.sphere-ex.com/Diagram_Console_EN_5f98720b3f.png)\n\n\n### SphereEx-Console Advantages\n\n**Easy to Use**\n\nIt improves the user experience and eliminates configuration errors. Users are not required to operate the SphereEx Enterprise Data Service Platform through configuration commands, greatly improving user experience. \n\n**Comprehensive**\n\nIt provides a unified solution for the management and control of the SphereEx Enterprise Data Service Platform - from basic resources to plugin capabilities.\n\n**Visual Monitoring**\n\nWith its data monitoring & management dashboard, SphereEx Enterprise Data Service Platform's clusters, instances and hosts monitoring data are visible online and in real time.\n\n### Industry Leading\n\nThe release of SphereEx-Console is an essential milestone for SphereEx's data management ecosystem. It improves and evolves Apache ShardingSphere in areas such as management difficulty and user interface. \n\nThe user interface greatly reduces enterprise operations & maintenance teams' learning costs, while the unified data management platform greatly improves operations and maintenance efficiency.\n\nAs a business founded the open source project Apache ShardingSphere's core team, SphereEx continues to enhance data governance as well as management & control capabilities. We are committed to providing users with a comprehensive Apache ShardingSphere application ecosystem and SphereEx enterprise grade capabilities.\n\n[Click here for more details!](https://sphere-ex.com/en/products/console/)","date":"2022-01-26","author":"SphereEx","excerpt":"Enhancing Enterprise Data Governance Capabilities","metaDescription":null,"createdAt":"2022-03-11T09:38:54.812Z","updatedAt":"2022-09-27T08:42:51.504Z","publishedAt":"2022-03-11T09:59:17.395Z","locale":"en","caseStudiesType":{"data":null},"cover":{"data":{"id":178,"attributes":{"name":"SphereEx-Console.png","alternativeText":"SphereEx-Console.png","caption":"SphereEx-Console.png","width":3751,"height":1596,"formats":{"thumbnail":{"name":"thumbnail_SphereEx-Console.png","hash":"thumbnail_Sphere_Ex_Console_46205ff4d3","ext":".png","mime":"image/png","width":245,"height":104,"size":26.2,"path":null,"url":"https://official-media.sphere-ex.com/thumbnail_Sphere_Ex_Console_46205ff4d3.png"},"large":{"name":"large_SphereEx-Console.png","hash":"large_Sphere_Ex_Console_46205ff4d3","ext":".png","mime":"image/png","width":1000,"height":425,"size":183.98,"path":null,"url":"https://official-media.sphere-ex.com/large_Sphere_Ex_Console_46205ff4d3.png"},"medium":{"name":"medium_SphereEx-Console.png","hash":"medium_Sphere_Ex_Console_46205ff4d3","ext":".png","mime":"image/png","width":750,"height":319,"size":129.65,"path":null,"url":"https://official-media.sphere-ex.com/medium_Sphere_Ex_Console_46205ff4d3.png"},"small":{"name":"small_SphereEx-Console.png","hash":"small_Sphere_Ex_Console_46205ff4d3","ext":".png","mime":"image/png","width":500,"height":213,"size":72.9,"path":null,"url":"https://official-media.sphere-ex.com/small_Sphere_Ex_Console_46205ff4d3.png"}},"hash":"Sphere_Ex_Console_46205ff4d3","ext":".png","mime":"image/png","size":345.31,"url":"https://official-media.sphere-ex.com/Sphere_Ex_Console_46205ff4d3.png","previewUrl":null,"provider":"dine-strapi-provider-upload-aws-s3","provider_metadata":null,"createdAt":"2022-03-11T09:32:09.548Z","updatedAt":"2022-03-11T09:32:09.548Z"}}},"metaLogo":{"data":null},"localizations":{"data":[{"id":12,"attributes":{"feature":true,"title":"增强企业数据服务及管控能力｜SphereEx-Console 可视化数据管控平台正式发布","content":">**1 月 27 日，SphereEx 正式推出可视化数据服务管控平台：SphereEx-Console。**\n>\n>作为一款以管理 ShardingSphere 为核心的 SphereEx 商业数据服务集群平台，SphereEx-Console 以平台的形式简化用户配置，极大简化用户操作和部署流程，进而降低新手入门门槛和企业管控难度，进一步提升企业运维效率。\n\n随着数据体量增长以及前端业务敏捷性的要求，金融、政府、传统制造等领域均面临着提升底层数据架构适配性、面向分布式生态进行架构升级。但传统集中式数据库在海量数据承载能力方面存在先天性不足，于是近些年来分布式数据库不断涌现，很好地满足这一诉求。但我们也看到，分布式架构天然的复杂性，对使用者提出了更高的要求，如何在新架构下简化用户体验，便捷普惠地享受到新架构带来的优势，成为各家重点考虑的因素。\n\n作为近些年火热的开源项目，Apache ShardingSphere 的应用范围越来越广，越来越多的企业选择采用 “数据库 + ShardingSphere” 的方式来实现传统关系型数据库到分布式数据库的转型过渡。以 Apache ShardingSphere 为基础，在原有数据库之上构建一套数据中间平台，将分布式数据服务增强能力部署在中间层，而不需对底层数据架构做出调整，进而帮助企业以更加平滑的方式获得分布式以及云上迁移能力。\n\n因此，为进一步降低用户应用门槛，拓宽 Apache ShardingSphere 的使用范围，**SphereEx 在开源内核 Apache ShardingSphere 的基础上推出 SphereEx-Console 可视化数据管控平台。** 作为一款以管理 ShardingSphere 为核心的 SphereEx 商业数据服务集群平台，SphereEx-Console 以平台的形式简化用户配置，极大简化用户操作和部署流程，进而降低新手入门门槛和企业管控难度，进一步提升企业运维效率。\n\n## 什么是 SphereEx-Console\n\n**SphereEx 控制台主要用于对 SphereEx 数据平台的运维管控，在互联网、金融、政务行业均能够支持运维和开发人员常见的操作场景。**\n\n作为一款以管理 ShardingSphere 为核心的 SphereEx 商业数据服务集群平台，SphereEx-Console 可视化数据管控平台以简便易用的操作界面代替相对复杂代码输入方式，结合内部针对资源、实例、插件等多种功能封装，为用户带来一站式的使用体验。\n\n![1.png](https://official-media.sphere-ex.com/1_5bd2d7ea7f.png)\n\n### 产品优势\n\n**功能易用**\n\n提高了用户体验，避免了配置错误，用户不需要通过配置和命令操作 SphereEx 企业数据服务平台，易用性得到极大提升，实现了平台使用的“零”瓶颈。\n\n**功能全面**\n\n完善开源版本的管理能力，提供了对 SphereEx 企业数据服务平台从基础资源到插件能力的管控，形成了对周边插件实现统一管控的解决方案。\n\n**功能可视**\n\n原生提供可视化的监控数据面板，可以实时在线查看 SphereEx 企业数据服务平台的集群、实例、主机的监控数据。\n\n\n### 行业价值\n\n**本次 SphereEx-Console 的发布，是 SphereEx 在数据管理生态下一次关键尝试，弥补了 Apache ShardingSphere 过去在管理易用性、可视化界面等维度的不足。** SphereEx-Console 以可视的操作界面，极大降低了企业运维人员的学习成本；统一的数据管控平台，也极大提升了企业的运维管理效率。\n\n作为一家以开源项目 Apache ShardingSphere 为基本的商业化公司，SphereEx 将持续增强自身在数据治理、管控等方面的能力，配以周边完善的生态基础，为用户提供更加全面和完善的 Apache ShardingSphere 应用生态以及 SphereEx 产品矩阵能力。\n\n**[点击了解详情](https://sphere-ex.com/zh/products/console/)**","date":"2022-01-26","author":"SphereEx","excerpt":"提供企业级的平台管控能力","metaDescription":null,"createdAt":"2022-03-11T09:39:49.579Z","updatedAt":"2022-03-11T09:55:15.098Z","publishedAt":"2022-03-11T09:40:24.284Z","locale":"zh"}}]}}},"prev":{"id":21,"attributes":{"feature":false,"title":"Apache ShardingSphere & CITIC Industrial Cloud","content":"_To further understand application scenarios, and enterprises’ needs, and improve dev teams’ understanding of Apache ShardingSphere, our community launched the “Enterprise Visits” series._\n\nOn February 28, the Apache ShardingSphere core development team visited CITIC Industrial Cloud Co., Ltd at the invitation of the company. During the meetup, Zhang Liang, Apache ShardingSphere PMC Chair and SphereEx Founder provided details on open source ecosystem building, and ShardingSphere production scenario-oriented solutions.\n\n[CITIC Group](https://www.citic.com/en/#Businesses) is China’s largest conglomerate. It is engaged in a wide variety of businesses, from property development to heavy industry to resources, though its primary focus is the financial sector, including banking and securities.\n\n[CITIC Industrial Cloud Co., Ltd](https://www.citictel-cpc.com/en-eu/product-category/cloud-computing), fully owned by CITIC Group, has developed an open service platform providing industrial internet applications and services in multiple fields such as IoT, smart cities, smart water services — with a desire to promote the digital transformation of traditional industries.\n\nNow, CITIC Industrial Cloud is exploring how to innovate with existing database systems, to support the innovative development of multiple industries.\n\nAs one of the most prominent open source middleware projects, with its ever-expanding ecosystem,[Apache ShardingSphere](https://shardingsphere.apache.org/) can meet some of CITIC Industrial Cloud’s technology needs in its development roadmap.\n\n\n\n## Ensuring Data Consistency in Data Migration\n\nEnterprises are challenged by ever expanding data related issues. Luckily, Scale-out can solve this problem.\n\nApache ShardingSphere allows online elastic scaling through its [Scaling tool ](https://shardingsphere.apache.org/document/current/en/features/scaling/)and provides multiple built-in data consistency verification algorithms, to ensure the consistency between data source and data on the client-side.\n\n[CRC32](https://crc32.online/) is used by default to strike a balance between speed and consistency; while the verification algorithm supports user-defined SPI.\n\nSince the time data migration takes is proportional to data volumes, to ensure data consistency, a downtime window is required to make the log level. Data will be verified through Scaling, at the business layer, and database layer.\n\nApache ShardingSphere can divide data migration into multiple sessions and execute them at the same time, merge modification operations of the same record, and execute a line command after configuration to stop write into the primary database, so the database is read-only.\n\nAdditionally, SQL execution is suspended during the read-only period since the data is globally consistent when write is disabled. Accordingly, the impact on system usability will be reduced when performing database switches.\n\n## JDBC and Proxy are Designed for Different Core Users\nApache ShardingSphere now supports access through JDBC and Proxy together with Mesh in the cloud (TODO). Users can choose the product that can best suit their needs to perform operations such as data sharding, read/write splitting, and data migration on original clusters.\n\n[ShardingSphere-JDBC](https://shardingsphere.apache.org/document/current/en/overview/#shardingsphere-jdbc) is designed for Java developers. It’s positioned as a lightweight Java framework, or as an enhanced JDBC driver with higher performance. If the performance loss is between 2% and 7%, and you want to optimize the performance, ShardingSphere-JDBC can help reduce the loss to less than 0.1%. Developers can directly access databases through the JDBC client and the service is provided in `.jar`, which means no extra deployment or dependency is needed.\n\n[ShardingSphere-Proxy](https://shardingsphere.apache.org/document/current/en/overview/#shardingsphere-proxy) is a database management proxy designed for operation and maintenance personnel. Generally, when users need to access databases through Proxy, the network connection may lead to a 30% to 70% performance loss. Therefore, the performance of ShardingSphere-JDBC is much better than that of ShardingSphere-Proxy.\n\nHowever, the plugin-oriented architecture of ShardingSphere provides dozens of extension points based on SPIs. On the basis of these extension points, ShardingSphere by default implements functions such as data sharding, read/write splitting, data encryption, shadow database stress testing and high availability, and allows developers to extend these functions at will.\n\nShardingSphere-JDBC adopts a decentralized architecture, applicable to high-performance, lightweight OLTP Java applications.\n\nShardingSphere-Proxy provides static access and supports all languages, suitable for OLAP applications and sharding database management and operations.\n\nWhile JDBC can boost development efficiency, Proxy can deliver better O&M performance. Through [DistSQL](https://medium.com/nerd-for-tech/intro-to-distsql-an-open-source-more-powerful-sql-bada4099211), you can leverage Apache ShardingSphere as if you were using a database natively. This helps improve the development capabilities of Ops teams and enterprises’ data management capabilities.\n\nThanks to the combination of ShardingSphere-JDBC and ShardingSphere-Proxy, while adopting the same sharding strategy in one registry center, ShardingSphere can create an application system suitable for all scenarios. This database gateway-like model allows users to manage all underlying database clusters through Proxy and observe distributed cluster status through SQL, and it can, therefore, enable maintainers and architects to adjust the system architecture to the one that can perfectly meet their business requirements and facilitate business operations.\n\n## ShardingSphere Federated Queries\nSQL Federation queries are a query mode providing cross-database querying capabilities. Users can execute queries without storing the data in the same database.\n\nThe SQL Federation engine contains processes such as SQL Parser, SQL Binder, SQL Optimizer, Data Fetcher and Operator Calculator, suitable for dealing with co-related queries and subqueries cross multiple database instances. At the underlying layer, it uses [Calcite](https://calcite.apache.org/) to implement RBO (Rule Based Optimizer) and CBO (Cost Based Optimizer) based on relational algebra, and query the results through the optimal execution plan.\n\nAs concepts such as data warehouse and data lake are gaining popularity, the applications of ShardingSphere SQL Federation are multiple.\n\nIf the user needs to perform a Federation query in a relational database, it can be easily implemented by ShardingSphere. Although data lake deployment is rather complex, ShardingSphere allows federated computations for data inside and outside the data lake by docking with databases, achieving `LEFT OUTER JOIN`,` RIGHT OUTER JOIN`, complex aggregate queries, etc.\n\n## Apache ShardingSphere Project Links:\n[ShardingSphere Github](https://github.com/apache/shardingsphere/issues?page=1&q=is%3Aopen+is%3Aissue+label%3A%22project%3A+OpenForce+2022%22)\n\n[ShardingSphere Twitter](https://twitter.com/ShardingSphere)\n\n[ShardingSphere Slack](https://apacheshardingsphere.slack.com/ssb/redirect)\n[\nContributor Guide](https://shardingsphere.apache.org/community/cn/contribute/)\n\n## Author\n**Yacine Si Tayeb**\n\nSphereEx Head of International Operations\nApache ShardingSphere Contributor\nPassionate about technology and innovation, Yacine moved to Beijing to pursue his Ph.D. in Business Administration and fell in awe of the local startup and tech scene. His career path has so far been shaped by opportunities at the intersection of technology and business. Recently he took on a keen interest in the development of the ShardingSphere database middleware ecosystem and Open-Source community building.\n\n\n\n\n\n\n","date":"2022-03-29","author":"SphereEx","excerpt":"CITIC Group is China's largest conglomerate. Now, CITIC is exploring how to innovate with existing database systems together with Apache ShardingSphere.\n","metaDescription":"CITIC Limited is the conglomerate in China and an established global player, with businesses covering financial services, resources and energy, manufacturing, engineering contracting and real estate as well as others.","createdAt":"2022-09-26T07:30:47.927Z","updatedAt":"2022-09-27T07:00:13.601Z","publishedAt":"2022-09-27T07:00:13.595Z","locale":"en","caseStudiesType":{"data":{"id":1,"attributes":{"name":"Finance","createdAt":"2021-12-11T23:01:56.177Z","updatedAt":"2021-12-11T23:01:58.635Z","publishedAt":"2021-12-11T23:01:58.567Z","locale":"en"}}},"cover":{"data":{"id":341,"attributes":{"name":"CITIC.png","alternativeText":"CITIC.png","caption":"CITIC.png","width":720,"height":389,"formats":{"thumbnail":{"name":"thumbnail_CITIC.png","hash":"thumbnail_CITIC_6be834d667","ext":".png","mime":"image/png","width":245,"height":132,"size":59.75,"path":null,"url":"https://official-media.sphere-ex.com/thumbnail_CITIC_6be834d667.png"},"small":{"name":"small_CITIC.png","hash":"small_CITIC_6be834d667","ext":".png","mime":"image/png","width":500,"height":270,"size":216.53,"path":null,"url":"https://official-media.sphere-ex.com/small_CITIC_6be834d667.png"}},"hash":"CITIC_6be834d667","ext":".png","mime":"image/png","size":295.62,"url":"https://official-media.sphere-ex.com/CITIC_6be834d667.png","previewUrl":null,"provider":"strapi-provider-upload-s3-compat","provider_metadata":null,"createdAt":"2022-09-26T07:31:53.040Z","updatedAt":"2022-09-26T07:31:53.040Z"}}},"metaLogo":{"data":{"id":355,"attributes":{"name":"CITIC logo.jpg","alternativeText":"CITIC logo.jpg","caption":"CITIC logo.jpg","width":960,"height":540,"formats":{"thumbnail":{"name":"thumbnail_CITIC logo.jpg","hash":"thumbnail_CITIC_logo_69bc3ea16b","ext":".jpg","mime":"image/jpeg","width":245,"height":138,"size":4.77,"path":null,"url":"https://official-media.sphere-ex.com/thumbnail_CITIC_logo_69bc3ea16b.jpg"},"medium":{"name":"medium_CITIC logo.jpg","hash":"medium_CITIC_logo_69bc3ea16b","ext":".jpg","mime":"image/jpeg","width":750,"height":422,"size":18.97,"path":null,"url":"https://official-media.sphere-ex.com/medium_CITIC_logo_69bc3ea16b.jpg"},"small":{"name":"small_CITIC logo.jpg","hash":"small_CITIC_logo_69bc3ea16b","ext":".jpg","mime":"image/jpeg","width":500,"height":281,"size":11.89,"path":null,"url":"https://official-media.sphere-ex.com/small_CITIC_logo_69bc3ea16b.jpg"}},"hash":"CITIC_logo_69bc3ea16b","ext":".jpg","mime":"image/jpeg","size":20.09,"url":"https://official-media.sphere-ex.com/CITIC_logo_69bc3ea16b.jpg","previewUrl":null,"provider":"strapi-provider-upload-s3-compat","provider_metadata":null,"createdAt":"2022-09-26T08:48:30.170Z","updatedAt":"2022-09-26T08:48:30.170Z"}}},"localizations":{"data":[]}}},"article":{"id":14,"attributes":{"feature":false,"title":"Asia’s E-Commerce Giant Dangdang Increases Order Processing Speed by 30% — Saves Over Ten Million in Technology Budget with  Apache ShardingSphere","content":">Apache ShardingSphere is an easy-to-use and stable product, making Dangdang’s warehouse management system (WMS) even more powerful. Integrated with WMS, ShardingSphere plays a vital role in reforming the supply chain system.\n>-- Li Yong, Head of WMS Technology, Dangdang\n\nFollowing Apache ShardingSphere 5.0.0 GA release in November 2021, the 5.1.0 version was released last month. Having gone through over two years of polishing, ShardingSphere’s plugin-oriented ecosystem is beginning to take shape, and the project embarks on the evolution from a simple data sharding middleware to a mature distributed database ecosystem driven by the concept of Database Plus.\n\nDangdang, established at the end of 1999, has become a leading e-commerce platform selling books of any kind, and by integrating new Internet technologies with the traditional book industry. Dangdang was founded during the surge in China’s Internet industry in the early 2000s.\n\nLater, the e-commerce industry became exremely competitive in the country, and the market saturated. Facing fierce market competition, e-commerce platforms had to adapt to remain competitive.\n\nIn response, Dangdang not only adjusted its business strategies and management approaches, but also upgraded its technology architecture. Dangdang didn’t have its warehouse management and transportation system at that time. However, with growing business volume and technological capabilities, Dangdang needed to rebuild its warehouse management system and transportation management system (TMS) to better satisfy its business needs. For instance, in terms of hardware, it replaced mini-computer with x86, while its old centralized system was transformed to a distributed system with more flexibility.\n\nOne of the biggest challenges was massive warehousing data storage. The engineers wanted to adopt the data sharding technology that was often chosen by other big Internet companies. Disappointingly, they failed to find a mature and versatile open source database middleware in the marketplace, and therefore,started to develop a new data sharding product. That’s the origin of Sharding-JDBC. The product was created to bring more possibilities to data services.\n\nDangdang released its new WMS five years ago, which meant that it completed its intelligent warehousing transformation. Since then, with Apache ShardingSphere, the WMS has enabled Dangdang to hold large online shopping events every year such as Dangdang’s April Reading Festival, Double-Eleven Online Shopping Festival (aka Singles Day), and Mid-Year Shopping Festival, and to manage over a dozen of smart warehouses.\n\n## Business Challenges\n\nWhen Dangdang adopted a third-party WMS, the database in use was Oracle based on IBM minicomputers.\n\nHowever, considering the increasing business volume and warehouse order requests, especially during the online shopping festivals, the traditional centralized database architecture of the old WMS became inadequate because the computing and storage capabilities were limited. Additionally, the scale-up solution couldn’t support the system during online shopping festivals, and therefore the developers must do scale-up and adjust the business layer several times to alleviate the storage and computing limits and avoid production risks.\n\n- **Limited computing and storage capabilities**\n\nA centralized architecture is less scalable, making database computing and storage capabilities become the bottleneck.\n\n- **Expensive development and maintenance cost**\n\nBecause of poor scalability, developers have to make concessions and scale-up, which increases system development and maintenance costs.\n\n- **Exclusiveness**\n\nIf the architecture is not open enough, the system is less flexible, with fewer functions, and difficult to be transformed. The current architecture makes it difficult to quickly adopt new business services such as cloud native ones, SQL audit, data encryption, and distributed governance.\n\n## The Solution\n\nBased on the situation described above, Dangdang’s tech team proposed a warehouse management system solution: in terms of hardware, IBM minicomputer would be replaced with all-purpose x86, and MySQL would replace Oracle.\n\nHowever, at that time, there wasn’t a versatile and mature enough open source database middleware living up to Dangdang’s expectations, so they created one and named it Sharding-JDBC.\n\nShardingSphere-JDBC is positioned as a lightweight Java framework that provides additional services at the Java Database Connectivity (JDBC) layer. It is lightweight, efficient, easy to use, and compatible.\n\nWith ShardingSphere providing services in the form of the .jar files package, users can connect the client directly to the database without additional deployment and dependencies. It can be seen as an enhanced JDBC driver, fully compatible with JDBC and all ORM frameworks.\n\n- Compatible with JDBC and any JDBC-based ORM framework such as JPA, Hibernate, Mybatis, Spring JDBC Template.\n\n- Supports all third-party database connection pools such as DBCP, C3P0, BoneCP, HikariCP, etc.\n\n- Supports all databases implementing JDBC standards. Currently, ShardingSphere-JDBC supports MySQL, PostgreSQL, Oracle, SQL Server, and any database that can be accessed via JDBC.\n\n![1.jpeg](https://official-media.sphere-ex.com/1_3d03cbca69.jpeg)\nThe ShardingSphere-JDBC Topography\n\nCurrently, Apache ShardingSphere consists of three products, i.e. JDBC, Proxy, and Sidecar (TODO). ShardingSphere-JDBC and ShardingSphere-Proxy can be deployed independently or together.\n\nIt is ShardingSphere-JDBC that is used in Dangdang’s warehouse management system.\n\n\n>So how is ShardingSphere-JDBC exactly utilized?\n\nIn the warehouse management system, each warehouse positioned in a physical city is referred to as a unit with its corresponding business system and databases. Each warehouse has three sets of MySQL primary-secondary clusters to load the warehousing data of the designated city. So far, Dangdang has more than ten self-built warehouses all over China, mostly in cities where customers place a large number of orders. This self-built warehouse model is flexible for warehouse management and helps reduce storage costs in the long run.\n\nIn terms of architecture, the WMS uses ShardingSphere-JDBC to do database sharding according to their business types, and each cluster stores specified business data. The three MySQL clusters of a single warehouse are divided into three types as follows:\n\n-** Basic:** stores user, area, and menu data.\n- **Business:** stores order and package data.\n- **Inventory:** stores stock and working data.\n\nBefore the release, the system was initialized based on the basic data of a warehouse, such as storage locations.\n\nNext, by deploying the distributed database middleware, Dangdang successfully solved a series of problems such as limited storage and computing capabilities, high costs, and lack of flexibility.\n\n![1.jpeg](https://official-media.sphere-ex.com/1_b7199ae49f.jpeg)\nTopography of Dangdang’s Warehouse Management System (of a Single Warehouse)\n\n## User Advantages\n\nApache ShardingSphere played a significant role in helping Dangdang develop its WMS. There are five main benefits:\n\n- **Extraordinary performance**\n\nThe ShardingSphere-JDBC lightweight framework makes its performance close to a native JDBC. Apart from its great database sharding capability, it helps database performance be taken to the extreme, which allows the WMS to work at full capacity.\n\n- **Keep the system stable**\n\nWMS has been functioning well since its release in 2016.\n\n- **Low risk & zero invasion**\n\nThe underlying system of Dangdang has been evolving since 2000. Thanks to its zero-intrusion nature, Apache ShardingSphere can be compatible with others with small modifications to meet Dangdang’s business requirements.\n\n- **Allow developers to focus on the business side**\n\nThe developer team does not need to worry about sharding any more and can concentrate on developing the system to meet business needs.\n\n- **Cost effective and efficient**\n\nSince ShardingSphere is known for its high compatibility, to satisfy increasing business needs, developers don’t have to reconstruct or upgrade the system, minimizing the migration cost.\n\nWarehousing order processing speed is increased by 30% and accordingly, tens of millions of manpower costs are reduced due to the smart warehouses and the auto storage location matching technology.\n\n**Apache ShardingSphere’s Roadmap**\n\nSome said that ShardingSphere is a product created by Dangdang. To be precise, ShardingSphere was derived from the company and it also donated ShardingSphere to the Apache Software Foundation (ASF) on November 10, 2018.\n\nAfter 17-months in the ASF incubator, Apache ShardingSphere successfully graduated on April 15, 2020, as a Top-Level Apache Project.\n\nRecently, to celebrate the third anniversary of ShardingSphere entering Apache Software Foundation(ASF), the community released ShardingSphere 5.0.0. Below is a brief review of Apache ShardingSphere.\n\n- In 2014, Dangdang introduced a centralized development framework targeting at its e-commerce platform called dd-frame. It was created to unify the development framework, standardize its technical components, and achieve efficient cross-team communication by separating business code from technical code. In this way, engineers can devote all their efforts to the business side. The relational database module named dd-rdb in the framework was developed to handle data access and implement the data sharding function. It was the precursor of Sharding-JDBC, as well as a major part of dd-frame 2.x.\n\n- In 2015, Dangdang decided to rebuild its WMS and TMS. As it needed a data sharding plan, the team launched the project in September. In December, 2015, Sharding-JDBC 1.0.0 was released and used within Dangdang.\n\n- In early 2016, Sharding-JDBC was separated from dd-rdb and became open source. The product is an enhanced JDBC driver providing service in .jar files.\n\n- At the end of 2017, Version 2.0.0 was released with the new data governance function.\n\n- In 2018, ShardingSphere was enrolled into Apache Incubator. The release of Version 3.0.0 was a notable turnaround: Sharding-Proxy was released as an independent service. It supported heterogeneous languages, and the project was renamed from Sharding-JDBC to ShardingSphere. It’s in 2018 that the community decided to build the criteria and ecosystem above databases.\n\n- In 2019, Version 4.0.0 was released capable of supporting more database products.\n\n- In 2020, ShardingSphere graduated as a Top-Level Project of the ASF.\n\n- On November 10, 2021, Version 5.0.0 GA was released as a third-anniversity celebration with the whole Apache ShardingSphere community, and the distributed database industry.\n\n![1.jpeg](https://official-media.sphere-ex.com/1_83a06f3e37.jpeg)\nApache ShardingSphere—Roadmap\n\nSince Version 5.0.0, Apache ShardingSphere has embarked on its new journey: with the plugin oriented architect at its core, it evloved from a data sharding application to a comprehensive and enhanced data governance tool applicable to various complex application scenarios. Concurrently, Apache ShardingSphere also has more features, and big data solutions.\n\n## Conclusion\n\nDigitization motivated Dangdang to achieve high-quality development and fulfill its mission. ShardingSphere is glad to support Dangdang’s WMS with its cutting-edging data services.\n\nHaving gone through two years‘ development, Apache ShardingSphere 5.0.0 GA has been released. The pluggable ecosystem marks an evolution from a data sharding middleware tool to a pioneer in the industry following the “Database Plus” concept.","date":"2022-03-11","author":"SphereEx","excerpt":"Apache ShardingSphere is easy-to-use and stable, making Dangdang’s warehouse management system (WMS) even more powerful.","metaDescription":"Dangdang is a B2C-based e-commerce company in China offering a large selection of products both online and offline.","createdAt":"2022-04-29T10:52:10.330Z","updatedAt":"2022-09-28T02:42:43.896Z","publishedAt":"2022-04-29T10:52:12.009Z","locale":"en","caseStudiesType":{"data":{"id":9,"attributes":{"name":"Internet","createdAt":"2022-09-26T10:34:03.086Z","updatedAt":"2022-09-27T06:59:34.838Z","publishedAt":"2022-09-27T06:59:34.836Z","locale":"en"}}},"cover":{"data":{"id":340,"attributes":{"name":"dangdang1.jpeg","alternativeText":"dangdang1.jpeg","caption":"dangdang1.jpeg","width":720,"height":466,"formats":{"thumbnail":{"name":"thumbnail_dangdang1.jpeg","hash":"thumbnail_dangdang1_27d7d16721","ext":".jpeg","mime":"image/jpeg","width":241,"height":156,"size":25.62,"path":null,"url":"https://official-media.sphere-ex.com/thumbnail_dangdang1_27d7d16721.jpeg"},"small":{"name":"small_dangdang1.jpeg","hash":"small_dangdang1_27d7d16721","ext":".jpeg","mime":"image/jpeg","width":500,"height":324,"size":91.72,"path":null,"url":"https://official-media.sphere-ex.com/small_dangdang1_27d7d16721.jpeg"}},"hash":"dangdang1_27d7d16721","ext":".jpeg","mime":"image/jpeg","size":153.14,"url":"https://official-media.sphere-ex.com/dangdang1_27d7d16721.jpeg","previewUrl":null,"provider":"strapi-provider-upload-s3-compat","provider_metadata":null,"createdAt":"2022-09-26T07:12:49.980Z","updatedAt":"2022-09-26T07:12:49.980Z"}}},"metaLogo":{"data":{"id":351,"attributes":{"name":"dangdang logo.jpg","alternativeText":"dangdang logo.jpg","caption":"dangdang logo.jpg","width":500,"height":256,"formats":{"thumbnail":{"name":"thumbnail_dangdang logo.jpg","hash":"thumbnail_dangdang_logo_539787f05a","ext":".jpg","mime":"image/jpeg","width":245,"height":125,"size":5.42,"path":null,"url":"https://sphereex-media-1305704183.cos.ap-beijing.myqcloud.com/thumbnail_dangdang_logo_539787f05a.jpg"}},"hash":"dangdang_logo_539787f05a","ext":".jpg","mime":"image/jpeg","size":12.11,"url":"https://sphereex-media-1305704183.cos.ap-beijing.myqcloud.com/dangdang_logo_539787f05a.jpg","previewUrl":null,"provider":"strapi-provider-upload-s3-compat","provider_metadata":null,"createdAt":"2022-09-26T08:37:49.195Z","updatedAt":"2022-10-12T05:57:41.631Z"}}},"localizations":{"data":[{"id":13,"attributes":{"feature":true,"title":"ShardingSphere 助力当当 WMS：订单效率提升 30%、节约成本上千万","content":">Apache ShardingSphere 简单易用且成熟稳定，当当自研 WMS 如虎添翼，在供应链系统改革中起到了至关重要的作用，是我们的杀手锏。\n——李勇，当当 WMS 技术负责人\n\n>Apache ShardingSphere 5.0.0 GA 已于 2021 年 11 月发布，5.1.0 版本也于上周发布。历经两年的迭代与打磨，可插拔生态趋近成熟，标志着 Apache ShardingSphere 从分库分表中间件蜕变为以 Database Plus 为理念的分布式数据库生态系统。\n\n近年来，随着“建设社会主义文化强国”政策的持续落实，全民阅读在移动互联快速发展中得到大力倡导，阅读给当代人提供了丰富的精神食粮。当当成立于 1999 年底，作为新技术与传统行业的结合体，当当融合了互联网新技术和传统图书行业，二十余年深耕图书领域助力全民阅读。\n\n当当在刚成立的几年，也是中国互联网腾飞的阶段，电商逐渐多元化发展的趋势迎来了行业野蛮生长期，各电商平台的发展如逆水行舟，不进则退。当当对战略和管理等方面进行调整的同时，也对技术架构层进行了硬核升级。\n\n当当成立之初的仓储物流系统并非自研，随着业务体量、技术实力等多方面的变化，为了满足业务快速发展需要，当当决定重构 WMS（Warehouse Management System）和 TMS（Transportation Management System）。硬件层使用 x86 取代小机，数据层由传统集中式转型为更灵活的分布式架构。如何解决海量仓储货品信息问题，是重构待解决的核心问题之一。互联网技术栈比较常用的分库分表被率先尝试使用，但由于当时开源数据库中间件的成熟度及功能方面不满足预期，当当决定自研分库分表产品，Sharding-JDBC 就这样应运而生，为“连接”带来更多可能。\n\n**自研 WMS 的上线完成了仓储层智能改革，五年、十余仓，Apache ShardingSphere 同 WMS 完美支撑了数个“读书节”、“618”和“11.11”等大型促销活动。**\n\n\n## 业务挑战\n\n当当在自研 WMS 之前使用的是第三方仓储管理系统，其数据库是基于 IBM 小机的 Oracle，结合当当业务体量以及电商仓储物流在促销期间密集请求的业务特点，传统集中式数据库架构给 WMS 带来了极大的挑战。\n\n在业务快速发展的冲击下，数据库计算和存储能力的上限越发明显，Scale-up 方案难以满足超级促销期间的业务需求，技术团队需要对业务层多次做拆分调整来缓解“存算”瓶颈，产能存在受限的风险。\n\n- 计算、存储能力双受限\n\n传统集中式架构扩展能力相对较差，数据库的计算和存储能力成为明显瓶颈；\n\n- 业务开发维护成本高昂\n\n在扩展能力相对差的基础上，业务侧需要不断的去让步做拆分，开发和维护成本持续攀升；\n\n- 系统架构开放度不足\n\n系统架构开放度不足将会使系统面临灵活度欠佳、功能缺失以及转型难度高等问题，基于现有架构难以快速响应新业务的开展及相关政策的调整，如云原生、SQL 审计、数据脱敏以及分布式治理等多方面需求。\n\n\n## 解决方案\n\n当当技术部结合现状及未来发展等多维度的调研，最终确定了自研 WMS 的方案。在硬件方面全面采用通用的 x86 设备替换 IBM 小型机，数据库层面引入开源数据库 MySQL 来替换 Oracle。当时已有多个开源数据库中间件，但成熟度和功能方面与预期不符，因此选择了自研数据库中间件，Sharding-JDBC 闪亮登场。\n\nShardingSphere-JDBC 定位为轻量级 Java 框架，在 Java 的 JDBC 层提供额外服务。具备轻量、高效、易用以及高兼容等特点。它使用客户端直连数据库，以 jar 包形式提供服务，无需额外部署和依赖，可理解为增强版的 JDBC 驱动，完全兼容 JDBC 和各种 ORM 框架。\n\n- 适用于任何基于 JDBC 的 ORM 框架，如：JPA、Hibernate、Mybatis、Spring JDBC Template 或直接使用 JDBC；     \n\n- 支持任何第三方的数据库连接池，如：DBCP、C3P0、BoneCP、HikariCP 等；\n\n- 支持任意实现 JDBC 规范的数据库，目前支持 MySQL、PostgreSQL、Oracle、SQL Server 以及任何可使用 JDBC 访问的数据库。\n\n![当当1.png](https://official-media.sphere-ex.com/1_16c3bbe14b.png)\n\nShardingSphere-JDBC 方案\n\n目前 Apache ShardingSphere 由 JDBC、Proxy 和 Sidecar（规划中）这 3 款既能够独立部署，又支持混合部署配合使用的产品组成，在当当自研 WMS 中使用的是 ShardingSphere-JDBC。\n\n那么 ShardingSphere-JDBC 在 WMS 中具体是如何应用的呢？\n\n在 WMS 系统中，城市的“仓”就是仓储系统的管理单位，每个仓有对应的业务系统和数据库，单个仓使用 3 套 MySQL 主从集群承载指定城市仓库的数据。目前，当当在全国各地设有十余个自建的仓库，主要分布在订单量较大的城市，这种自建仓库模式在具备灵活管理等特性的同时，也可以降低企业的长期仓储成本。\n\n在架构规划上，WMS 通过 ShardingSphere-JDBC 按业务类型进行分库， 每套集群负责存储指定的业务数据，单个仓的 3 套 MySQL 集群分工如下：\n\n- 基础库集群：User，Area，Menu；\n\n- 业务库集群：Order，Package；\n\n- 库存库集群：Stock，Working。\n\n上线前，系统会根据仓库的基础数据进行初始化，如货位等信息，这里不做深入讨论。\n\n分布式数据库中间件的架构解决了 WMS 存算受限、开发维护成本高以及系统灵活度不足的问题，以成熟的底座和熟悉的技术栈去承载业务，架构相对透明化，兼容度良好且没有入侵性。\n\n![当当2.png](https://official-media.sphere-ex.com/2_783843d774.png)\n\n当当 WMS 系统拓扑图（单仓）\n\n\n## 用户收益\n\n在当当自研 WMS 的过程中发挥了非常重要的作用，带来了五方面的收益如下：\n\n1、性能极致\n\nShardingSphere-JDBC 轻量级的框架使其性能接近原生 JDBC，提供分库能力的同时性能可发挥极致，WMS 产能不再有受限的风险；\n\n2、系统稳定\n\n自 2016 年 WMS 上线至今，数年来系统一直稳定运行；\n\n3、低风险、零侵入\n\n当当底层系统为 2000 年演进而来，Apache ShardingSphere 凭借自身零侵入性的特点，用很小的改动就即完成了兼容适配，满足了业务需求；\n\n4、专注业务开发\n\n研发团队无需再关心业务拆分的工作，可将更多的精力聚焦于业务需求；\n\n5、降本增效\n\n高兼容的特点可以在无需大量的重构和改造前提下满足业务增长的需求，改造迁移成本低；     \n\n通过仓店智能化、入库商品自动匹配最优货位的设计，仓店订单效率提升了 30%，人力成本节约上千万。\n\n\n## Apache ShardingSphere 的前世今生\n\n有人说 ShardingSphere 是当当的产品，其实更准确的说：ShardingSphere 起源于当当，在 2018 年 11 月 10 日捐赠给 Apache，经 17 个月的孵化于 2020 年 4 月 15 毕业，是 2020 年度第一个从 Apache 孵化器毕业的顶级项目。\n\n前段时间，在 ShardingSphere 进入 Apache 基金会三周年的纪念日（2021/11/10）里，社区发布了期待已久的 5.0 正式版，借着这个机会，一起回顾 Apache ShardingSphere 的前世今生。\n\n- 2014 年，当当针对电商平台推出了统一开发框架 dd-frame，目的是通过分离业务和技术代码，实现开发框架统一化、技术组件标准化以及跨组沟通高效化，使研发人员的精力最大化的聚焦在业务开发上。开发框架中名为 dd-rdb 的关系型数据库模块专门用于负责数据访问，可实现简单的分库分表功能，它就是 Sharding-JDBC 的前身，也是 dd-frame 2.x 中重点规划的部分。     \n \n- 2015 年，当当决定重构 WMS 和 TMS，设计上需要引用分库分表方案，天时地利人和，当当架构部在 9 月正式启动了项目，同年 12 月份 Sharding-JDBC 1.0.0 在当当内部发布，正式开启了 ShardingSphere 的征途。\n \n- 2016 年初，Sharding-JDBC 从 dd-rdb 中剥离，向社区开源，产品形态是增强版 JDBC 驱动，以 jar 包形式提供服务。\n \n- 2017 年底，发布 2.0.0 版本，打开了数据库治理功能。\n\n- 2018 年，进入 Apache 软件基金会。3.0.0 版本是一个华丽的转身，独立服务形态的 Sharding-Proxy 面世，实现了异构开发语言的需求，同时项目名称从 Sharding-JDBC 更名为 ShardingSphere，迈出了构建数据库上层标准和生态的第一步。     \n \n- 2019 年，发布 4.0.0 版本，可支持更多的数据库产品。\n \n- 2020 年，毕业成为 Apache 软件基金会的顶级项目。    \n\n- 2021 年 11 月 10 日，发布 5.0.0 GA 版，作为加入 Apache 软件基金会三周年纪念日的礼物，呈现给社区及整个分布式数据库和安全生态领域。     \n\n![当当3.png](https://official-media.sphere-ex.com/3_ae2b522cd5.png)\n Apache ShardingSphere - RoadMap\n\n从 5.0.0 版本开始，Apache ShardingSphere 正式开启了以可插拔架构为核心的全新阶段，实现了由过去数据分片单一应用场景到现在复杂应用环境下综合数据治理的身份转变与能力提升。在新版本中，Apache ShardingSphere 具备了更多新特性，并拥有了更加成熟的大数据解决方案。\n\n首先，基于可插拔架构对内核进行了全面改造，内核中的各个功能可以任意组合并叠加使用。其次，为了提升 SQL 分布式查询能力，5.0.0 GA 版打造了全新的 Federation 执行引擎，来满足用户复杂的业务场景。此外，5.0.0 GA 版在内核功能 API 层面也进行了大量优化，旨在降低用户使用这些功能的成本。\n\n## 写在结尾\n\n全链条数字化驱动着当当高质量发展，让全民阅读触手可及。在必不可少的自研 WMS 一环中，ShardingSphere 在数据层提供了强力支撑。\n\nApache ShardingSphere 历经两年的迭代与打磨，5.0.0 GA 版本已面世。趋近成熟的可插拔生态，标志着 Apache ShardingSphere 从分库分表中间件工具蜕变为以 Database Plus 理念为新航标。重塑分布式可插拔体系，助力整个数据库行业带来新风向和更有价值的解决方案。\n\n更多内容欢迎点击阅读原文链接访问中文社区 OpenSEC（Open SphereEx Community），一起畅聊开源。\n\n","date":"2022-04-29","author":"SphereEx","excerpt":"历经两年的迭代与打磨，可插拔生态趋近成熟，标志着 Apache ShardingSphere 从分库分表中间件蜕变为以 Database Plus 为理念的分布式数据库生态系统。","metaDescription":null,"createdAt":"2022-04-29T08:49:24.970Z","updatedAt":"2022-11-02T05:36:20.351Z","publishedAt":"2022-04-29T08:49:28.304Z","locale":"zh"}}]}}}}},
    "staticQueryHashes": []}