Version 29 (modified by 17 months ago) ( diff ) | ,
---|
Distributed Data Infrastructure
Project Advisor: Professor Alexei Kotelnikov
Team Members: Keshav Subramaniyam, Jason Zhiyuan Zhang, Samyak Agarwal, Anna Kotelnikov, Gyana Deepika Dasara
Objective Of This Project
The objective of the project "Distributed Data Infrastructure focuses in general on developing a Ceph file system as well as stress testing the system's robustness and resilience. In order for us, to be able to accomplish this goal, we are learning multiple concepts such as the Linux operating systems, file systems, networking, as well as Ansible.
Week 1
- Understood the goal of the project.
- Installed packages and wired a cluster of 8 servers.
- Got familiar with Linux.
Week 2
- Installed Debian Linux
- Solidified our understanding with networking as well as the Network File Systems (NFS).
Week 3
- Went over Shell Scripting and Python Scripting
- Worked With Distributed File Systems
- Performance Testing for ZFS and also MDRAID
Week 4
- Focus on Ceph installation
- Did some troubleshooting relating to OSDs
Presentation Links
https://docs.google.com/presentation/d/1-KpBGlFWiV0LEJFXrU6Nk_VxNchvado48oIbh6KHOdk/edit#slide=id.p https://docs.google.com/presentation/d/1Pujv2HFNYLHuhLFh_0tSRZg4yv6gs8nNNyNNcMXD8s8/edit#slide=id.p
Attachments (19)
- TT_tree_mobile.jpeg (14.5 KB ) - added by 17 months ago.
- June5.jpg (1.4 MB ) - added by 17 months ago.
- June6_1.jpg (124.3 KB ) - added by 17 months ago.
- June6.jpg (126.2 KB ) - added by 17 months ago.
- June6_2.jpg (201.3 KB ) - added by 17 months ago.
- June6_2.2.jpg (201.3 KB ) - added by 17 months ago.
- cluster.jpg (43.6 KB ) - added by 17 months ago.
- WINLAB presentation week 6_19 (1).jpg (53.9 KB ) - added by 17 months ago.
- WINLAB presentation week 6_19 (2).jpg (53.9 KB ) - added by 17 months ago.
- Ceph diagram.png (105.0 KB ) - added by 17 months ago.
- IMG_6645.jpg (46.8 KB ) - added by 16 months ago.
- Screen Shot 2023-08-07 at 2.34.32 PM.png (141.5 KB ) - added by 16 months ago.
- Screen Shot 2023-08-07 at 2.52.50 PM.png (482.1 KB ) - added by 16 months ago.
- Screen Shot 2023-08-07 at 2.54.45 PM.png (74.2 KB ) - added by 16 months ago.
- Ceph.png (130.2 KB ) - added by 16 months ago.
- PerformanceTestingGraphs.png (74.2 KB ) - added by 16 months ago.
- Ansible-Playbook.png (141.5 KB ) - added by 16 months ago.
- SLURM.png (482.1 KB ) - added by 16 months ago.
- PerformanceTestingGraphs.2.png (74.2 KB ) - added by 16 months ago.