I wish to train a convolutional neural network to detect "Object X" using TensorFlow in Python.
The problem is, there is a second "Object Y" that looks identical to Object X, and the only way to differentiate between the two is to examine other sensor data.
Sorry, I have to be vague with what exactly I'm talking about as my employer doesn't want the details made public.
In any case, is there a way of providing the sensor data to the CNN so that it can determine by itself if an image contains Object X or Object Y, even though they are identical (when seen in photographs)?
Or would it be easier to just use a regular CNN to get classifications, and then do an "if" function depending on the value of the sensors?
e.g. if CNN detects Object X, and sensor value is less than 30, then image contains Object Y, but if sensor value is greater than 30, then image contains Object X. Would that be easier than trying to teach a CNN how to handle both the images and sensor data?
Thanks in advance.
Dear David,
Kindly go through the following link:
https://www.tensorflow.org/tutorials/layers
Dear David Hunter,
Look the link, please.
https://www.tensorflow.org/tutorials/layers
https://medium.com/@tifa2up/image-classification-using-deep-neural-networks-a-beginner-friendly-approach-using-tensorflow-94b0a090ccd4
Regards, Shafagat
What you need is a labelled large training set? The difference, although subtle would be detected, I believe, by the CNN.
Dear David,
Kindly go through the following link:
https://www.tensorflow.org/tutorials/layers
Send the raw image through the all the layers of your CNN and append the sensor data directly to the last fully connected layers (bypassing all the convo, pooling and normalization layers) . The network will automatically learn to use sensor data by using the same conventional training algorithm on the above setup.
Hi Ravimal; thanks for that response. That's exactly what I'm after.
I have had a look around on Google for examples on how to do this, but wasn't able to find any. Would you know of any examples on how to do this please?
Thanks again for your help. :)
- Badges
- Science topic
- Similar topics
- Computer Science and Engineering
- Programming Languages
- Python