Hello,
We are planning to undertake a clinical study that is centered around recording movement data from IMU sensors alongside video recordings of individuals. We aim to establish a ML model, which can predict mediation states based on motion of individuals. For this purpose, we would like to rate the motion/symptom profile of individuals every, say, 2 minutes on the video. We are looking for a platform, which can help us streamline this process. Ideally, it would display video and IMU data synchronised on the left, and on the right would allow a rater to enter labels in prespecified categories. Having spent some time on google, I can only find computer vision tools, which are not really what we are looking for.
Any suggestions are welcome and would help us out a lot. I am happy to share some more details on what exactly we are looking for :)
Currently, I am using MATLAB for: (1) modeling and simulation, (2) machine learning/ deep learning/ customized training model, (3) data processing, (4) image/video processing analysis, (5) animation and visualization, and (6) optimization.
Depending on your purpose/skill/ background, you can find your own software. However, I think MATLAB is best choice for your problem, since it contains numerous built-in functions for various tasks. Therefore, you do not need to start from scratch.
You might need two different models which can be used in an ensamble mode. As your application consists of two different types data (IMU sensor data and videos), so for IMU data analysis you might need a regression model and video data analysis you will be using a convolutional model. At the end you can join the prediction of both models fro final decision.
Alsalamo Alikom Philipp Brunnbauer
I think you can use python/matlab/C on
free simulators like raisim ---https://raisim.com/
or gazebo on ROS ---- https://www.ros.org/
raisim has open source libraries for deep learning.
You need to try and see if it fits your target or not.
Best wishes
Hey, these are not really what I am looking for. I do not need help with regards on how to process IMU data. We do not conduct image/video processing on the videos. They are merely used to generate labels for the IMU data. The tool should look something like this image.
MATLAB R2019a and above versions are well suited for Machine learning as well as deep learning. MATLAB provide good visualizations, image batch preprocessing, deep network designer etc. Hassle free processing of large data and many add-in options to improve processing which numerous functions that can combine with other functions over the data to get results. Image Labeler app and Ground Truth Label app can be helpful
List of products:
https://in.mathworks.com/products.html?s_tid=gn_ps
MATLAB is best option
I think you need to use Python, Matlab, C to built this interface to show the reality videos.
Also for training purposes your Machine learning may need a simulator.
I think that Raisim + Python or Matlab will help a lot in machine learning.
You can check: https://ch.mathworks.com/products/reinforcement-learning.html
If you find something a better way let us know :)
Best wishes of happiness and success
We have PyTorch and tensorflow for Machine Learning in Python. Or you could use MATLAB for Machine Leraning where you will have a GUI based work. It comes with a toolbox rather than libraries in python. ML is playful in MATLAB than python.
Start with sci-kit learn. https://scikit-learn.org/stable/
Once you are good with sci-kit learn, then you move to PyTorch or TensorFlow.
- Badges
- Science method
- Similar topics
- Mathematics
- Statistics
- Statistical Modeling
- Analyses of Variance
- ANOVA