Streamlining Backup Management
with Amazon S3, Glacier & VEEAM
About The Customer

The National Open Schooling System(NOSS) is an autonomous organization in India that operates under the Ministry of Education, Government of India. NOSS offers vocational education programs as part of its broader mission to provide flexible and inclusive education. NOSS's vocational education programs are designed to equip learners with practical skills and knowledge relevant to specific trades and industries.

Key features of Vocational NOSS Portal include:
  • Course Information
  • Admission and Registration
  • Study Materials
  • Assessment and Examination
  • Online Learning Resources
  • Student Support Services
  • Results and Certification
  • FAQs and Helpdesk
  • Feedback and Suggestions
  • Latest Announcements
Customer Challenge:

NOSS is the largest open school board in India which caters to the needs of a heterogeneous group of learners up to the pre-degree level. The board provides opportunities to interested learners by making Courses/Programmes of Study available through open and distance learning (ODL) mode. It was formed in 1989 and since then, more than 6 lakh students have been enrolled every year. In the last 5 years, it marks 4.13 million students' cumulative enrollment and due to regulatory compliance, the student data must remain in the database for 5 years. To maintain the humongous data there was a need for storage and student information retrieval was required at any point in time. It created a problem for the board to manage and maintain the data. The board has several modules deployed on AWS infrastructure; one is the Result correction module. Every day results are uploaded and daily backups are being made.

The daily backup size of DB is close to 89 GB which in the next five years becomes approximately 162 TB which will in turn generate large amount of data in the AWS S3 bucket.

But, due to the high storage cost of S3, we suggested they should use S3 Glacier which is comparatively has a low storage cost.

The cost was minimized but per compliance, data needs to be moved to archival after 10 days and auto- deletion after 60 months. It was becoming difficult to identify which data to be archived from S3 standard or S3 Glacier. And then we asked them to use a third-party solution, – Veeam.

Solutions:

Insphere recommended a storage strategy using Amazon S3 and Glacier for efficient handling of daily backups. The goal is to establish a clear and standardized solution that balances data accessibility, cost efficiency, and compliance with data management best practices. However, due to the non-monitoring facility available in S3 standard and Glacier, it was becoming a problematic situation for the client to identify the data that needs to be moved from Standard to Glacier and later on moved to archival state.

To resolve all the issues, we recommended using one of the ISV – “Veeam” which helped the client to identify which data from S3 standard is required to move to S3 Glacier and for archiving. The data backup was taken from the DB present in the EC2 machine.

It helped them to archive the data for a longer period, with faster recovery and recoverable anytime, anywhere.

The benefits of using Veeam are:
  • Data Monitoring and Identification
  • Data Archival
  • Cost optimization
  • Secure Backup
  • Faster recovery

To deploy Veeam in the whole value chain, we provided a step-by-step guide to the client and implemented a lifecycle policy on Veeam, ensuring the seamless transition of objects from S3 Standard to Glacier after 10 days which made it easier for archiving & automated deletion of versions after 60 months. We aim to streamline the data management processes, enhance cost-effectiveness for the client, and align the practices with industry standards and regulatory requirements

Architecture Diagram

Jsp
Jsp
Outcome:

The implementation of a database backup lifecycle policy strategy for NIOS has led to several significant improvements, particularly in terms of cost efficiency and data management:

We are saving 92% on RDS backup storage costs by utilizing a lifecycle policy to transition backups to Glacier after 10 days. These improvements reflect the successful implementation of a tiered storage strategy, resulting in optimized data management, cost efficiency, and adherence to best practices for NOSS’s database backup system.

Benefit:

The outcome encompasses improved cost efficiency, data accessibility, compliance, automation, enhanced data integrity, and scalability, establishing a reliable and optimized backup infrastructure.

Insphere Competency:

Successfully implemented Life Cycle policy to move all the data from S3 to Glacier

Identified an ISV – VeeAm which helped the client to resolve their data management issues by Archiving

Post-implementing the VeeaAm ISPL helped the client in accessing the data in quick time.

Saved their cost of maintaining the data in S3 standard for a longer time.

Used Technology Stack

We have technical expertise in most of trusted Technology and framework

Infra & Billing Partners
Our empanelment with parent body
It’s involves modernizing and optimizing an organization’s data management, analytics, and security to align with the company’s digital transformation objectives.