Changes between Version 32 and Version 33 of Other/Summer/2024/lLM

Timestamp:

Aug 7, 2024, 2:12:11 AM (4 months ago)

Author:

Jonathan123

Comment:

—

Other/Summer/2024/lLM

@@ -138 +138 @@
 2. **Research Paper**: Presented a research paper on Weighted Average Reward Models to Professor Ortiz and team. The paper discussed the benefits of WARM to traditional ensembling methods. Ultimately, the WARM model performs much better with improved efficiency in order to mitigate reward hacking. During the presentation, Professor gave us valuable advice regarding academic presentations, and taught us how to interpret and explain visual data in a concise manner to an audience.
 3. **Final Presentation**: We worked on creating the final presentation for the WINLAB Open House on August 7th. This final presentation will encompass the high-level objectives of our project and will go into detail regarding the contributions our research group made during our 5 weeks at WINLAB. In addition to the slides, we worked on designing a poster for our research project which will be hung at WINLAB. 
+4. **Visualization**: We wanted to figure out a way to have visualization of streaming data of experiments, which led to the plan of having LED lights switch on and off on the Maestro itself or the Raspberry Pi 3B+. However, after in-depth research, the conclusion was made that there is no real and safe way to do this. The LED light in the Maestro is attached to a sensor, and trying to manipulate it can lead to incorrect data output. We tried controlling the onboard LED lights in the Raspberry Pi, but attempts at this causes harm to the internal hardware of the Pi, and should be avoided. Since a physical visual appeal isn't approachable we decided to stick to a graphical appeal that demonstrates which Maestros are running data for the experiments. This allows for a safe and accurate way of presenting visual streaming data from the multi-modal Maestro sensor.