Optimizing Data Management: Exploring Our Implementation of the AWS Primary Storage Solutions

Posted By :

Praveen

29 September, 2024

Background

Our client belongs to government department in India responsible for the promotion and preservation of the country's diverse cultural heritage. It formulates policies and programs related to art, music, dance, literature, theatre, archaeology, museums, libraries, and other aspects of Indian culture. It’s primary goal is to safeguard and promote India's rich cultural traditions, both at the national and international levels.

Challenges

In the vast land of India, with 7.5 lakh villages and an incredible wealth of cultural treasures, the Client faced many challenges. The on-premise servers, burdened with the responsibility of preserving this heritage, struggled to keep pace with the sheer volume of data pouring in. Each day, photos, videos, PDFs, and Excel files showcasing the vibrant tapestry of India's art, music, and folk were directly uploaded to the on-premise server. The lack of a classified storage system made data management an intricate puzzle. So in search of scalability and robust storage they decided to move to the cloud.

“Lift and shift” were done. Here the data flows from USER, SERVER, S3. Another problem happened during an event when 3 Lakh villages participated and uploading a significant amount of data to the server directly, leads to flooding the server & as a result server stopped responding even on the cloud.

Solutions Offered:

InSphere schedule pre-sales activity with the institution and identify various parameter for assessment:

Determine the specific reasons for migration

Identify Workloads based on the criticality, dependencies, and resource requirements

Evaluate the current infrastructures that include
• Servers to be moved
• Database size, type and estimated yearly incremental volume
• Running applications, tools, and OS
• Total Disk Volume

Frequency of Backup

Hence to mitigate the challenge that occurred post migration, InSphere came with a solution and asked for client consent to implement it. After the successful migration of workload, InSphere suggested to the IT department of the client that instead of uploading the data directly to the server we can provision it to upload into the S3 through the “Signed URL” concept. This way we can avoid undue use of the server. Client agreed and deployment modified as per the new model. We configured services like CloudWatch & CloudTrial to monitor the CPU & RAM utilization of the machine.

Outcome:

The migration to cloud technology has not only addressed previous challenges but also achieved significant improvements across several metrics

System Downtime Improved by 98%
Reduced downtime due to cloud elasticity and implementation of signed URL solutions.
Data Upload Success Rate Improved by 39%
Enhanced upload success rates facilitated by the adoption of signed URLs.
Server Utilization 70% Less server utilization
Drastically reduced server load, optimizing resource efficiency.
Performance Improvement Improved by 34%
Significant improvement in overall system performance, ensuring smoother operations.

These improvements reflect the client successful transition to cloud infrastructure, resulting in enhanced reliability,efficiency and operational effectiveness.

Benefit:

Cloud adoption not only addressed previous challenges, but achieved the several other benefits as well. By embracing cloud technology, client significantly reduce their IT infrastructure costs by eliminating the need for physical servers and hardware maintenance. The client website, once susceptible to crashes, now flourished under the cloud's elasticity. The cultural enthusiasts across the nation experienced an uninterrupted flow of inspiration and knowledge

Insights

Industry Segments We Serve

Company

Unveiling Our AWS Primary Storage Solutions