JeVoisBase
1.21
JeVois Smart Embedded Machine Vision Toolkit Base Modules
|
|
Object recognition using Coral Edge TPU. More...
Public Member Functions | |
__init__ (self) | |
Constructor. | |
process (self, inframe, outframe) | |
JeVois main processing function. | |
processGUI (self, inframe, helper) | |
Process function with GUI output. | |
Public Attributes | |
threshold | |
rgb | |
model | |
labels | |
interpreter | |
timer | |
Object recognition using Coral Edge TPU.
This module runs an object classification deep neural network using the Coral TPU library. It only works on JeVois-Pro platform equipped with an Edge TPU add-on card. Classification (recognition) networks analyze a central portion of the whole scene and produce identity labels and confidence scores about what the object in the field of view might be.
This module supports networks implemented in TensorFlow-Lite and ported to Edge TPU/
Included with the standard JeVois distribution are:
See the module's constructor (init) code and select a value for model to switch network.
Object category names for models trained on ImageNet are at https://github.com/jevois/jevoisbase/blob/master/share/opencv-dnn/classification/synset_words.txt
Sometimes it will make mistakes! The performance of SqueezeNet v1.1 is about 56.1% correct (mean average precision, top-1) on the ImageNet test set.
This module is adapted from the sample code: https://github.com/google-coral/pycoral/blob/master/examples/classify_image.py
More pre-trained models are available at https://coral.ai/models/
Definition at line 53 of file PyCoralClassify.py.
PyCoralClassify.PyCoralClassify.__init__ | ( | self | ) |
Constructor.
Definition at line 56 of file PyCoralClassify.py.
References jevois.getNumInstalledTPUs().
PyCoralClassify.PyCoralClassify.process | ( | self, | |
inframe, | |||
outframe | |||
) |
JeVois main processing function.
Definition at line 83 of file PyCoralClassify.py.
References TensorFlow.interpreter, PyCoralClassify.PyCoralClassify.interpreter, PyCoralDetect.PyCoralDetect.interpreter, PyCoralSegment.PyCoralSegment.interpreter, TensorFlow.labels, mobilenet_v1.MobileNetV1.labels, mobilenet_v2.MobileNetV2.labels, PyCoralClassify.PyCoralClassify.labels, PyCoralDetect.PyCoralDetect.labels, TensorFlow.model, mobilenet_v1.MobileNetV1.model, mobilenet_v2.MobileNetV2.model, lpd_yunet.LPD_YuNet.model, mp_palmdet.MPPalmDet.model, PyNetOpenCV.PyNetOpenCV.model, PyNetORT.PyNetORT.model, PyNetURetinex.PyNetURetinex.model, PyClassificationDNN.PyClassificationDNN.model, PyCoralClassify.PyCoralClassify.model, PyCoralDetect.PyCoralDetect.model, PyCoralSegment.PyCoralSegment.model, PyDetectionDNN.PyDetectionDNN.model, PyEmotion.PyEmotion.model, PyLicensePlate.PyLicensePlate.model, PyClassificationDNN.PyClassificationDNN.rgb, PyCoralClassify.PyCoralClassify.rgb, PyCoralDetect.PyCoralDetect.rgb, PyCoralSegment.PyCoralSegment.rgb, PyDetectionDNN.PyDetectionDNN.rgb, PyEmotion.PyEmotion.rgb, PyCoralClassify.PyCoralClassify.threshold, PyCoralDetect.PyCoralDetect.threshold, AprilTag.AprilTag.timer, FirstPython.FirstPython.timer, PyClassificationDNN.PyClassificationDNN.timer, PyCoralClassify.PyCoralClassify.timer, PyCoralDetect.PyCoralDetect.timer, PyCoralSegment.PyCoralSegment.timer, PyDetectionDNN.PyDetectionDNN.timer, PyDMTX.PyDMTX.timer, PyEmotion.PyEmotion.timer, PyFaceMesh.PyFaceMesh.timer, PyHandDetector.PyHandDetector.timer, PyLicensePlate.PyLicensePlate.timer, PyObjectron.PyObjectron.timer, PyPoseDetector.PyPoseDetector.timer, PySceneText.PySceneText.timer, PySelfie.PySelfie.timer, PythonObject6D.PythonObject6D.timer, PythonOpenCV.PythonOpenCV.timer, PythonParallel.PythonParallel.timer, PythonSandbox.PythonSandbox.timer, and PythonTest.PythonTest.timer.
PyCoralClassify.PyCoralClassify.processGUI | ( | self, | |
inframe, | |||
helper | |||
) |
Process function with GUI output.
Definition at line 126 of file PyCoralClassify.py.
References TensorFlow.interpreter, PyCoralClassify.PyCoralClassify.interpreter, PyCoralDetect.PyCoralDetect.interpreter, PyCoralSegment.PyCoralSegment.interpreter, TensorFlow.labels, mobilenet_v1.MobileNetV1.labels, mobilenet_v2.MobileNetV2.labels, PyCoralClassify.PyCoralClassify.labels, PyCoralDetect.PyCoralDetect.labels, TensorFlow.model, mobilenet_v1.MobileNetV1.model, mobilenet_v2.MobileNetV2.model, lpd_yunet.LPD_YuNet.model, mp_palmdet.MPPalmDet.model, PyNetOpenCV.PyNetOpenCV.model, PyNetORT.PyNetORT.model, PyNetURetinex.PyNetURetinex.model, PyClassificationDNN.PyClassificationDNN.model, PyCoralClassify.PyCoralClassify.model, PyCoralDetect.PyCoralDetect.model, PyCoralSegment.PyCoralSegment.model, PyDetectionDNN.PyDetectionDNN.model, PyEmotion.PyEmotion.model, PyLicensePlate.PyLicensePlate.model, PyClassificationDNN.PyClassificationDNN.rgb, PyCoralClassify.PyCoralClassify.rgb, PyCoralDetect.PyCoralDetect.rgb, PyCoralSegment.PyCoralSegment.rgb, PyDetectionDNN.PyDetectionDNN.rgb, PyEmotion.PyEmotion.rgb, PyCoralClassify.PyCoralClassify.threshold, PyCoralDetect.PyCoralDetect.threshold, AprilTag.AprilTag.timer, FirstPython.FirstPython.timer, PyClassificationDNN.PyClassificationDNN.timer, PyCoralClassify.PyCoralClassify.timer, PyCoralDetect.PyCoralDetect.timer, PyCoralSegment.PyCoralSegment.timer, PyDetectionDNN.PyDetectionDNN.timer, PyDMTX.PyDMTX.timer, PyEmotion.PyEmotion.timer, PyFaceMesh.PyFaceMesh.timer, PyHandDetector.PyHandDetector.timer, PyLicensePlate.PyLicensePlate.timer, PyObjectron.PyObjectron.timer, PyPoseDetector.PyPoseDetector.timer, PySceneText.PySceneText.timer, PySelfie.PySelfie.timer, PythonObject6D.PythonObject6D.timer, PythonOpenCV.PythonOpenCV.timer, PythonParallel.PythonParallel.timer, PythonSandbox.PythonSandbox.timer, and PythonTest.PythonTest.timer.
PyCoralClassify.PyCoralClassify.interpreter |
Definition at line 76 of file PyCoralClassify.py.
Referenced by PyCoralClassify.PyCoralClassify.process(), PyCoralDetect.PyCoralDetect.process(), PyCoralSegment.PyCoralSegment.process(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), and PyCoralSegment.PyCoralSegment.processGUI().
PyCoralClassify.PyCoralClassify.labels |
Definition at line 73 of file PyCoralClassify.py.
Referenced by mobilenet_v1.MobileNetV1._postprocess(), mobilenet_v2.MobileNetV2._postprocess(), PyCoralClassify.PyCoralClassify.process(), PyCoralDetect.PyCoralDetect.process(), PyCoralClassify.PyCoralClassify.processGUI(), and PyCoralDetect.PyCoralDetect.processGUI().
PyCoralClassify.PyCoralClassify.model |
Definition at line 64 of file PyCoralClassify.py.
Referenced by lpd_yunet.LPD_YuNet.__init__(), PyNetOpenCV.PyNetOpenCV.freeze(), PyNetORT.PyNetORT.freeze(), PyNetURetinex.PyNetURetinex.freeze(), mobilenet_v1.MobileNetV1.infer(), mobilenet_v2.MobileNetV2.infer(), lpd_yunet.LPD_YuNet.infer(), mp_palmdet.MPPalmDet.infer(), PyNetOpenCV.PyNetOpenCV.load(), PyNetORT.PyNetORT.load(), PyNetURetinex.PyNetURetinex.load(), PyClassificationDNN.PyClassificationDNN.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralDetect.PyCoralDetect.process(), PyCoralSegment.PyCoralSegment.process(), PyDetectionDNN.PyDetectionDNN.process(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), PyCoralSegment.PyCoralSegment.processGUI(), PyLicensePlate.PyLicensePlate.processGUI(), mobilenet_v1.MobileNetV1.setBackend(), mobilenet_v2.MobileNetV2.setBackend(), lpd_yunet.LPD_YuNet.setBackend(), mp_palmdet.MPPalmDet.setBackend(), mobilenet_v1.MobileNetV1.setTarget(), mobilenet_v2.MobileNetV2.setTarget(), lpd_yunet.LPD_YuNet.setTarget(), and mp_palmdet.MPPalmDet.setTarget().
PyCoralClassify.PyCoralClassify.rgb |
Definition at line 61 of file PyCoralClassify.py.
Referenced by PyClassificationDNN.PyClassificationDNN.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralDetect.PyCoralDetect.process(), PyCoralSegment.PyCoralSegment.process(), PyDetectionDNN.PyDetectionDNN.process(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), and PyCoralSegment.PyCoralSegment.processGUI().
PyCoralClassify.PyCoralClassify.threshold |
Definition at line 60 of file PyCoralClassify.py.
Referenced by PyCoralClassify.PyCoralClassify.process(), PyCoralDetect.PyCoralDetect.process(), PyCoralClassify.PyCoralClassify.processGUI(), and PyCoralDetect.PyCoralDetect.processGUI().
PyCoralClassify.PyCoralClassify.timer |
Definition at line 79 of file PyCoralClassify.py.
Referenced by FirstPython.FirstPython.process(), PyClassificationDNN.PyClassificationDNN.process(), PyCoralClassify.PyCoralClassify.process(), PyCoralDetect.PyCoralDetect.process(), PyCoralSegment.PyCoralSegment.process(), PyDetectionDNN.PyDetectionDNN.process(), PyDMTX.PyDMTX.process(), PythonObject6D.PythonObject6D.process(), PythonOpenCV.PythonOpenCV.process(), PythonParallel.PythonParallel.process(), PythonSandbox.PythonSandbox.process(), AprilTag.AprilTag.processGUI(), PyCoralClassify.PyCoralClassify.processGUI(), PyCoralDetect.PyCoralDetect.processGUI(), PyCoralSegment.PyCoralSegment.processGUI(), PyFaceMesh.PyFaceMesh.processGUI(), PyHandDetector.PyHandDetector.processGUI(), PyLicensePlate.PyLicensePlate.processGUI(), PyObjectron.PyObjectron.processGUI(), PyPoseDetector.PyPoseDetector.processGUI(), PySceneText.PySceneText.processGUI(), PySelfie.PySelfie.processGUI(), PythonOpenCV.PythonOpenCV.processGUI(), PythonSandbox.PythonSandbox.processGUI(), PythonTest.PythonTest.processGUI(), FirstPython.FirstPython.processNoUSB(), PythonObject6D.PythonObject6D.processNoUSB(), and PythonSandbox.PythonSandbox.processNoUSB().