Changes between Initial Version and Version 1 of Other/Summer/2023/Inference

Timestamp:

Jul 5, 2023, 2:52:14 PM (2 years ago)

Author:

tm897

Comment:

—

Other/Summer/2023/Inference

@@ +1 @@
+Project Title: Resilient Edge-Cloud Autonomous Learning with Timely inferences
+Project Advisor and Mentors: Professor Anand Sarwate, Professor Waheed Bajwa, Nitya Sathyavageeswaran, Vishakha Ramani, Yu Wu, Aliasghar Mohammadsalehi, Muhammad Zulqarnain
+Names: Shreya Venugopaal, Haider Abdelrahman, Tanushree Mehta, Lakshya Gour, Yunhyuk Chang
+
+
+Objective: The purpose of this project is to use ORBIT in order to 
+
+Main objectives
+learn how to design and run experiments on ORBIT
+prototype a handoff scheme for ML prediction
+develop a latency profiling framework for MEC-assisted machine learning
+
+– Split the network, early exit, simulate multiple CPU speeds, network delays
+
+Progress
+Goals
+Team introductions
+Kickoff meetings
+Refining and understanding research questions
+go over goals for the summer
+For next week:
+Go through WINLAB orientation (TBD)
+Reading for next time:
+PPA Chapters 1 and 2
+Coding:
+install python (via Anaconda or something else)
+go through the interactive intro to python online or by downloading the notebook
+Review the basics of Python linked from the UT Austin site to learn basic syntax, flow control, etc.
+Week 2:
+Goals:
+Summary: 
+Basics of pattern recognition and Machine Learning (PPA - Patterns, Predictions, Actions)
+set up an instance using pytorch on an Orbit node
+Created a node image with Pytorch
+Basics of Pytorch
+Created small Machine Learning models
+Loaded the Modified National Institute of Standards and Technology (MNIST) database onto the node
+computed the second moment matrix
+Did PCA and SVM on MNIST
+Next Steps:
+Create and train a “small” and “large” Neural Network 
+Attempt to simulate the difference between their performances at inference
+Links:
+Week 3:
+Goals:
+Summary: 
+Created and Trained a ‘Small’ and ’Large’ Neural Networks
+Compared their performances on the CIFAR10 dataset
+Established connection between two nodes 
+Communicated test data between nodes to compare accuracy and delay between our NN models
+Need to serialize by bytes instead of transferring as strings
+Had a discussion on various research papers related to our project
+Next Steps:
+Send the data as bytes instead of strings
+Calculate the times for transfer & processing
+Read more papers related to stuff about early exit and edge cloud computing
+Divide data into “chunks” for faster and more efficient transmission
+Design experiments to test different architectures and implementations of Early Exiting and Split Computing
+Track and add Age of Information Metrics
+Presentation links: 
+Link - Lakshya
+Link - Shreya
+Link - Haider
+Link - James
+Link - Tanushree
+Week 4:
+Goals
+Summary
+Next Steps
+