{
    "componentChunkName": "component---src-templates-case-study-detail-ts",
    "path": "/case-studies/26",
    "result": {"pageContext":{"next":null,"prev":{"id":7,"attributes":{"feature":false,"title":"eHualu Story’s Data Processing Shortcut","content":"> ShardingSphere has greatly simplified sharding development and maintenance, which has played a very important role in our rapid product release. We estimate that ShardingSphere has saved us at least 4 months of R&D costs.\n> \n> –– Shi Moxuan, Technical Director，E-Hualu\n\nAt the beginning of this year, E-hualu officially launched its cloud service product “Hulu App” that targets non-business users. Since then, its architecture’s data stress has increased on a daily basis.\n\nThe R&D team of Hulu App chose to use ShardingSphere’s sharding features and scale their data out. The flexible and agile features of ShardingSphere met the requirements of Hulu App. It requires data extensibility, and needs to prevent the team from “reinventing the wheel”.\n\nShardingSphere can simplify sharding development and maintenance to the greatest extent. As the service is growing, the work will be increasingly complicated.\n\n### Hulu App’s growth pressure: feature extension and new services\n\nThe high requirement for data storage and computing is in the genes of the Hulu App technical team.\n\nBecause Hulu App is rapidly growing, its service and feature changes are relatively frequent. Therefore its technical team needs to adapt quickly when a front-end service changes. As its users and service data volume are growing rapidly, its databases are faced with greater pressure.\n\nThe official Hulu App was released on May 17, 2020, and then its user data and service volume also showed a rapid growth trend. Therefore it was inevitable to scale out its databases for many times. At the same time, with business requirements changing very quickly, new challenges have emerged:\n\n- How to ensure feature extensibility\n\nBecause of increasing users and developing product versions, its user data has exploded. The storage and computing capability of its old architecture has been severely challenged. Therefore, Hulu App requires that its back-end data processing platform shall have both extensible features, and flexibility.\n\n- How to improve efficiency\n\nFaced with its changeable services, the R&D team of Hulu App needs to make rapid adjustments when necessary, so as to make its architecture adapt to its services. A highly-flexible, extensible data architecture can greatly improve development efficiency of the team. On the other hand, because of such large amounts of data, database retrieval efficiency will inevitably have problems such as delays, slow read and write. These problems will ultimately affect user experience.\n\n- How to facilitate feature release\n\nAll new products will face problems like frequent new feature release, bringing the scheduled release date forward, when they are just released. These problems pose a great challenge to a development team. At first, Hulu’s development team planned to base on their service demands and create their own sharding plan all by themselves. However, they don’t have enough time to do that, so it’s urgent for them to choose a new sharding plan.\n\n- How to guarantee system stability\n\nA newly-added technology will greatly challenge system stability. It’s especially true for bottom-level technologies, most of which can influence platform services and probably challenge system stability. So what Hulu App needs is a data application product that does not greatly stress databases, but quickly adapts to them and that is also highly stable.\n\n### Leverage ShardingSphere’s features to Create a Flexible, Highly-Available Data Architecture Solution\n\nHulu App’s team studied their needs and spent two weeks evaluating ShardingSphere and other similar solutions. They had evaluative indicators like product feature, maturity, stability and performance. At last, they chose ShardingSphere because of its powerful features, its support and its high maturity can fully meet their needs.\n\nThe Hulu team deployed ShardingSphere above Alibaba Cloud’s RDS. Instead of adjusting ontology databases, the Hulu team prefers to conduct data governance above its databases. ShardingSphere can effectively improve Hulu’s data architecture, because it can achieve three things: high scalability brought by its extensible architecture, closely adaptive to Hulu’s service. ShardingSphere brings Hulu with obvious improvement:\n\n#### “High scalability” of the pluggable architecture\n\nDue to its service characteristics, Hulu App’s limited storage space is consumed very quickly, and the problem gradually begins to affect response efficiency at the front end. Therefore, the team can quickly develop enhanced features by using ShardingSphere, which can provide optimized solutions for its subsequent architectural adjustments. The example strengthens the ShardingSphere’s advantage in sharding.\n\n#### Closely adaptive to service\n\nThe smaller the architecture change is, the more controllable it is for developers. ShardingSphere, an ecosystem located above databases, is closer to service and it deployment is even more lightweight. So it is undoubtedly the best solution to solve the contradiction between the front-end service changes and back-end architecture adjustment of Hulu App. In addition, in terms of flexibility, ShardingSphere supports instant achievement of relevant configurations, which greatly helps the team save a lot of sharding-related work. So it plays a very important role in Hulu App’s quick releases.\n\n#### “Zero attack” to the service architecture\n\nHulu App chose ShardingSphere’s Proxy deployment mode. It can manage the real database cluster through Proxy without. replacing underlying databases. It basically completed the separation of service and data at the architectural level without any changes. So it can avoid the risks caused by database changes, such as unavailable service and long stable cycle. In addition, the non-status mode of ShardingSphere hardly has any perceptible impact on users at the front end and the service layer does not need to pay attention to the data storage method .\n\nSo, Hulu App is a product with tight go-live schedule and fast feature iteration. ShardingSphere-Proxy can reuse original databases and help the Hulu development team to develop incremental features above databases such as sharding and data encryption. In addition, ShardingSphere allows developers not to worry about database configuration and shields user perception, so it quickly builds service-oriented database direct connection, which is well separated from the system architecture level, and ensures that daily maintenance work at the database agent, such as bug repair and version update, will not affect the services.\n\nThis time, ShardingSphere collaborated with the R&D team of E-hualu’s Hulu App, and helped them overcome data volume explosion for several times. Actually, this is just a tiny example of ShardingSphere’s various application scenarios around the world.\n\n### About E-hualu & Hulu App\n\nFounded in 2001, Beijing E-hualu Information Technology Co., Ltd. is a listed company under the state-owned enterprise China Hualu Group Co., LTD. directly administrated by the State-owned Assets Supervision and Administration Commission of the State Council (SASAC). Its mission is to reduce energy consumption and the cost of long-term data management.\n\nHulu App is the first to-customer product of E-hualu.\n\n### ShardingSphere Community:\n\nShardingSphere Github: https://github.com/apache/shardingsphere\n\nShardingSphere Twitter: https://twitter.com/ShardingSphere\n\nShardingSphere Slack Channel: apacheshardingsphere.slack.com","date":"2021-11-29","author":"SphereEx","excerpt":"ShardingSphere has greatly simplified sharding development and maintenance, which has played a very important role in our rapid product release. We estimate that ShardingSphere has saved us at least 4 months of R&D costs.","metaDescription":"Founded in 2001, Beijing E-hualu Information Technology Co., Ltd. is a listed company under the state-owned enterprise China Hualu Group Co., LTD. directly administrated by the State-owned Assets Supervision and Administration Commission of the State Council (SASAC). Its mission is to reduce energy consumption and the cost of long-term data management.","createdAt":"2021-12-12T12:33:14.398Z","updatedAt":"2022-09-26T10:27:50.013Z","publishedAt":"2021-12-12T12:35:01.820Z","locale":"en","caseStudiesType":{"data":{"id":1,"attributes":{"name":"Finance","createdAt":"2021-12-11T23:01:56.177Z","updatedAt":"2021-12-11T23:01:58.635Z","publishedAt":"2021-12-11T23:01:58.567Z","locale":"en"}}},"cover":{"data":{"id":7,"attributes":{"name":"ehualu.png","alternativeText":"ehualu.png","caption":"ehualu.png","width":1030,"height":720,"formats":{"thumbnail":{"name":"thumbnail_ehualu.png","hash":"thumbnail_ehualu_6d29db12b5","ext":".png","mime":"image/png","width":223,"height":156,"size":6.16,"path":null,"url":"https://official-media.sphere-ex.com/thumbnail_ehualu_6d29db12b5.png"},"large":{"name":"large_ehualu.png","hash":"large_ehualu_6d29db12b5","ext":".png","mime":"image/png","width":1000,"height":699,"size":53.63,"path":null,"url":"https://official-media.sphere-ex.com/large_ehualu_6d29db12b5.png"},"medium":{"name":"medium_ehualu.png","hash":"medium_ehualu_6d29db12b5","ext":".png","mime":"image/png","width":750,"height":524,"size":33.7,"path":null,"url":"https://official-media.sphere-ex.com/medium_ehualu_6d29db12b5.png"},"small":{"name":"small_ehualu.png","hash":"small_ehualu_6d29db12b5","ext":".png","mime":"image/png","width":500,"height":350,"size":18.22,"path":null,"url":"https://official-media.sphere-ex.com/small_ehualu_6d29db12b5.png"}},"hash":"ehualu_6d29db12b5","ext":".png","mime":"image/png","size":24.54,"url":"https://official-media.sphere-ex.com/ehualu_6d29db12b5.png","previewUrl":null,"provider":"dine-strapi-provider-upload-aws-s3","provider_metadata":null,"createdAt":"2021-12-12T12:04:05.768Z","updatedAt":"2021-12-14T07:19:57.408Z"}}},"metaLogo":{"data":{"id":3,"attributes":{"name":"ehualu_logo.png","alternativeText":"ehualu_logo.png","caption":"ehualu_logo.png","width":303,"height":153,"formats":{"thumbnail":{"name":"thumbnail_ehualu_logo.png","hash":"thumbnail_ehualu_logo_26122a7add","ext":".png","mime":"image/png","width":245,"height":124,"size":22.6,"path":null,"url":"https://official-media.sphere-ex.com/thumbnail_ehualu_logo_26122a7add.png"}},"hash":"ehualu_logo_26122a7add","ext":".png","mime":"image/png","size":22.6,"url":"https://official-media.sphere-ex.com/ehualu_logo_26122a7add.png","previewUrl":null,"provider":"dine-strapi-provider-upload-aws-s3","provider_metadata":null,"createdAt":"2021-12-12T12:04:05.036Z","updatedAt":"2021-12-14T07:19:30.734Z"}}},"localizations":{"data":[{"id":2,"attributes":{"feature":false,"title":"葫芦 App 后台数据处理的逻辑捷径","content":"> ShardingSphere 大大简化了分库分表的开发和维护工作，对于业务的快速上线起到了非常大的支撑作用，保守估计 ShardingSphere 至少为我们节省了 4 个月的研发成本。\n> \n> –– 史墨轩，易华录·技术总监\n\n### 项目背景\n\n伴随着易华录旗下面向个人用户的云服务产品【葫芦 App】正式上线，后台架构所承受的业务压力也与日俱增。\n\n为此，葫芦 App 研发团队选择采用 ShardingSphere 分库分表的功能对数据进行了横向的拆分，围绕 ShardingSphere 灵活敏捷的特性，满足了葫芦 App 业务对数据层扩展性的要求，避免团队重复“造轮子”，最大程度简化了随着业务增长而带来的愈发复杂化的分库分表的开发与维护工作。\n\n### 业务挑战\n\n- 扩展能力\n- 效率提升\n- 上线提前\n- 成熟技术\n\n### 解决方案\n\n- 可插拔架构的『高扩展性』\n\n由于业务特性，葫芦 App 原本有限的存储空间被消耗得非常快，并逐渐开始影响用户在前端的响应效率。通过采用 ShardingSphere 的分片策略，葫芦研发团队在应对海量计算+存储所带来的业务问题同时，能够确保分片扩展策略的灵活性。基于此，葫芦团队可以在ShardingSphere 上快速做出相应的功能扩展，为后续架构调整提供优化方案，进一步强化突出了 ShardingSphere 分库分表的优势。\n\n- 距离业务更紧密的『贴合性』\n\n后台架构的变化越小，对于业务而言就越可控。ShardingSphere 这种位于数据库之上的生态，距离业务更近，部署起来也更加轻量，无疑是解决葫芦 App 前台业务变更与后台架构调整之间矛盾的最优解。此外在灵活性层面，ShardingSphere 通过相关配置即可实现的方式，极大简化了葫芦研发团队在分库分表层面的研发与维护工作，对于业务的快速上线起到了非常大的支撑作用。\n\n- 对于业务架构的『零侵入性』\n\n葫芦 App 选择了 ShardingSphere-Proxy 部署模式，在不更换底层数据库的前提下通过 Proxy 来管理真实的数据库集群，基本无需对业务进行改造就已经完成了业务与数据在架构层面的分离，并避免了因更换数据库导致的业务不可用、漫长稳定周期等风险。另外，ShardingSphere 的无状态模式，几乎不会对前端用户产生任何可感知的影响，业务层也无需关注数据的存储方式。\n\n![ehualu_zh_1.png](https://official-media.sphere-ex.com/ehualu_zh_1_3fad8e2ccd.png)\n\n### 用户收益\n\n- 节省 4 人月成本\n- 明显改善业务体验\n- 系统灵活扩容\n\n**SphereEx，让数据与应用连接更简单。**","date":"2021-11-29","author":"SphereEx","excerpt":"ShardingSphere 大大简化了分库分表的开发和维护工作，对于业务的快速上线起到了非常大的支撑作用，保守估计 ShardingSphere 至少为我们节省了 4 个月的研发成本。","metaDescription":"北京易华录信息技术股份有限公司，成立于 2001 年，是国务院国资委直接监管的中央企业中国华录集团旗下控股的上市公司，致力于建设城市数字经济基础设施。","createdAt":"2021-12-11T23:11:13.132Z","updatedAt":"2022-11-30T08:25:32.894Z","publishedAt":"2021-12-11T23:11:16.643Z","locale":"zh"}}]}}},"article":{"id":26,"attributes":{"feature":false,"title":"openGauss & ShardingSphere: A Top Distribution Solutions","content":"##About openGauss\n\nopenGauss is an open source relational database management system. Since its launch in June 2020, it has made waves the database management vertical. With an increasing number of partners and developers, it’s already reaping the benefits of the significant efforts & resources poured into building a successful database ecosystem.\n\n##Project Background\n\nFacing problems like data volume explosion, and super-high levels of concurrent data processing, openGauss made a choice: to adopt a distributed solution. It started to work on big data storage, throughput improvement for super-high concurrency, improving performance bottlenecks caused by large data amounts in a table, etc.\n\nApache ShardingSphere facilitates the distributed feature development of openGauss. Such collaboration on the full stack and open source solution helps openGauss make significant breakthroughs.\n\n##The Distributed Solution\n\nopenGauss integrates many open source components to optimize its full stack & open source distributed solution for horizontal scaling, distributed transactions, and distributed governance. Its framework is shown in Fig.1\n\n![Figure 1: The Structure of the ShardingSphere X openGauss Distribution Solution](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/s9knu2pwkmpsmvx6iwm2.png)\n\nShardingSphere-Proxy is the open source distributed database solution. \nShardingSphere’s well-known features include but are not limited to data sharding, distributed transaction, elastic scaling, and read-write splitting.\n\nHAProxy uses Patroni REST API to identify database master nodes and guarantee high availability, as well as load balancer.\n\nEvery high availability node of Patroni supports one master with multiple slaves and uses the Praxos protocols to keep data consistency, so that nodes are allowed to be deployed in the same site or in different sites to ensure multiple sites and centers data security.\n\nIn terms of the solution, ShardingSphere-Proxy contributes with its mighty distribution features, Kubernetes helps manage clusters, and prometheus monitors cluster status. This all-star team’s integration make the project a really powerful full stack, open source distribution solution.\n\n##What’s Special About the Project?\n\n + _Great extensibility and elastic scaling_\n\nHorizontal scaling helps realize the linear extension of computing and storage capabilities. The maximum shard count increases to 6400. Database performance improves accordingly and the problem of data volume explosion in single database is effectively managed.\n\nBased on users’ traffic condition, a user can flexibly scale data nodes, and adopt intelligent read-write splitting to realize automatic load balancing of a distributed database.\n\n+ _Enhanced enterprise-grade features_\n\nThe project provides users with various enterprise-grade features such as distributed data store, Trigger, distributed governance, comprehensive end-to-end encryption, and Workload Diagnosis Report (WDR)\n\n+ _Simple deployment_\n\nIt may take only a few seconds to deploy the project. Its deployment is simple while also being efficient as it adopts standardized image deployment to keep delivery consistent in different environments. It also uses container deployment as well as resource pooling so that it is less platform dependent.\n\n+ _Super-high availability and remote disaster recovery_\n\nThe project can effectively manage clusters and facilitate operations & maintenance. It follows the Paxos protocols to ensure data security and strong consistency and provides various features for disaster recovery, whose recovery point object (RPO) is zero. It supports resilient recovery methods for one region, cross-region, and multi-region & multi-center.\n\n+ _Open source ecosystem_\n\nThe open source project openGauss warmly welcomes more contributors, and encourages joint efforts to grow the open source database ecosystem.\n\n##Application Scenarios\n\n+ Financial system\n\nThe product is extremely reliable even for demanding financial systems. Paxos is a family of protocols for solving consensus in a network of unreliable and fallible processors. Besides being Paxos-based, the product includes powerful features such as distributed transaction with strong consistency, and multi-region multi-center disaster recovery whose RPO is 0.\n\n+ Government and enterprise operations\n\nIt’s really safe and convenient for government and enterprise operations due to its comprehensive end-to-end security protection, its hardware and software ecosystem support, and its high availability capabilities.\n\n+ Intelligent grid\n\nThe product’s flexible disaster recovery features can improve smart grid database scalability.\n\n##ShardingSphere Community:\n\n[ShardingSphere Github](https://github.com/apache/shardingsphere)\n\n[ShardingSphere Twitter] \n(https://twitter.com/ShardingSphere)\n\n[ShardingSphere Slack Channel](apacheshardingsphere.slack.com)\n\n\n\n\n\n","date":"2021-09-28","author":"SphereEx","excerpt":null,"metaDescription":"openGauss is an open source relational database management system that is released with the Mulan PSL v2. with the kernel built on Huawei’s years of experience in the database field and continuously provides competitive features tailored to enterprise-grade scenarios. In addition, openGauss is an open source database platform that encourages community contribution and collaboration.","createdAt":"2022-09-26T08:09:50.554Z","updatedAt":"2022-09-27T07:00:49.291Z","publishedAt":"2022-09-27T07:00:36.447Z","locale":"en","caseStudiesType":{"data":{"id":10,"attributes":{"name":"Software Development","createdAt":"2022-09-26T10:34:53.523Z","updatedAt":"2022-09-27T06:59:43.907Z","publishedAt":"2022-09-27T06:59:43.905Z","locale":"en"}}},"cover":{"data":{"id":346,"attributes":{"name":"openGauss1.png","alternativeText":"openGauss1.png","caption":"openGauss1.png","width":720,"height":411,"formats":{"thumbnail":{"name":"thumbnail_openGauss1.png","hash":"thumbnail_open_Gauss1_0781ec1284","ext":".png","mime":"image/png","width":245,"height":140,"size":31.7,"path":null,"url":"https://official-media.sphere-ex.com/thumbnail_open_Gauss1_0781ec1284.png"},"small":{"name":"small_openGauss1.png","hash":"small_open_Gauss1_0781ec1284","ext":".png","mime":"image/png","width":500,"height":285,"size":97.34,"path":null,"url":"https://official-media.sphere-ex.com/small_open_Gauss1_0781ec1284.png"}},"hash":"open_Gauss1_0781ec1284","ext":".png","mime":"image/png","size":124.92,"url":"https://official-media.sphere-ex.com/open_Gauss1_0781ec1284.png","previewUrl":null,"provider":"strapi-provider-upload-s3-compat","provider_metadata":null,"createdAt":"2022-09-26T08:07:47.594Z","updatedAt":"2022-09-26T08:07:47.594Z"}}},"metaLogo":{"data":{"id":361,"attributes":{"name":"openGauss logo.png","alternativeText":"openGauss logo.png","caption":"openGauss logo.png","width":275,"height":183,"formats":{"thumbnail":{"name":"thumbnail_openGauss logo.png","hash":"thumbnail_open_Gauss_logo_7b11da9186","ext":".png","mime":"image/png","width":234,"height":156,"size":11.4,"path":null,"url":"https://official-media.sphere-ex.com/thumbnail_open_Gauss_logo_7b11da9186.png"}},"hash":"open_Gauss_logo_7b11da9186","ext":".png","mime":"image/png","size":3.07,"url":"https://official-media.sphere-ex.com/open_Gauss_logo_7b11da9186.png","previewUrl":null,"provider":"strapi-provider-upload-s3-compat","provider_metadata":null,"createdAt":"2022-09-26T09:11:52.021Z","updatedAt":"2022-09-26T09:11:52.021Z"}}},"localizations":{"data":[]}}}}},
    "staticQueryHashes": []}