| 212 | For Week Eight, the group continued working on the Raspberry Pi in hopes to get PTP to run. In addition, as a backup plan, the group looked into buying specific hardware that would allow the PTP function without having to use software emulation. After some research, the hardware being leaned towards is the Compute Module 4 IO Board and the CM4 chip. It was looked into that the hardware method can also achieve better accuracy compared to software. |
| 213 | |
| 214 | '''(insert Compute module, CM4 chip, maybe PTP pic of transmit not there)''' |
| 215 | |
| 216 | Additionally, the group was able to breakdown and comprehend the past code written by the previous research members. It was found that the Web App created used '''Dash by Plotly''' to easily visualize and label the MAESTRO data. |
| 217 | |
| 218 | '''(insert Murtadha's website pic)''' |
| 219 | |
| 220 | Furthermore, the group continued exploring ROS/Unity through a ROS Point Cloud Visualizer. The point cloud is generated using LIDAR and the data is imported using the PCX library in Unity. With Unity and a first person camera, the room can be interacted with and explored. The goal in the future is for the LIDAR data to be sent in real time using '''ROS rvis''' (a 3D visualization tool). |
| 221 | |
| 222 | '''(insert point demo here)''' |
| 223 | |
| 228 | Starting Week 9, by using a blank Raspberry Pi with just the operating system installed, the group was successful in getting PTP to work. As seen, the "software-transmit" capability is now added. The group was also able to merge the "smartbox" folder with the PTP Pi; therefore, the MAESTROS are now able to send the sensor data to the database while having the capability of PTP. |
| 229 | |
| 230 | '''(insert software transmit screenshot)''' |
| 231 | |
| 232 | Moreover, the group was able to get the camera data to be sent to the data base in real-time. This data can then be analyzed using the Jupiter Notebook. |
| 233 | |
| 234 | '''(insert image of camera data)''' |
| 235 | |
| 236 | Finally, the group got to cloning the "perfect" SD card for the 6 Raspberry Pi's being used in the experiment. |
| 237 | |
| 241 | |
| 242 | ===Summary=== |
| 243 | After ten weeks, the group was successful in creating a functional website, designing a coordinate system, automating wifi processes, and installing PTP for the R-Pi’s, and explored the possible use of Unity/ROS. |
| 244 | |
| 245 | ===Future Work=== |
| 246 | For the future, the group is looking to modify certain aspects of the project as well as conducting experiments. |
| 247 | |
| 248 | Hardware for PTP: TimeCard mini Platinum Edition from OCP-TAP |
| 249 | Set up Maestros/Cameras in coordinate grid |
| 250 | data collection/labelling |
| 251 | |
| 252 | |
| 253 | Automatic labelling: Label activity using natural language descriptions of video data |
| 254 | Bridge gap between sensor-to-text |
| 255 | |