IVALab Python Libraries
Collection of code for computer vision and robotics with specific API.
|
Layered detector part of puzzle scene perceiver grouping. More...
Public Member Functions | |
def | __init__ (self, detCfg=None, detInst=None, processors=None) |
Constructor for layered puzzle scene detector. More... | |
def | adapt (self) |
Adapt the layer detection models. More... | |
def | correct (self) |
Apply correction process to the individual detectors. More... | |
def | detect (self, I) |
Apply predict, measure, correct process to source image. More... | |
def | emptyDebug (self) |
def | emptyState (self) |
Get and empty state to recover its basic structure. More... | |
def | getDebug (self) |
def | getState (self) |
Get the complete detector state, which involves the states of the individual layer detectors. More... | |
def | info (self) |
def | loadFrom (fPtr) |
def | measure (self, I) |
Apply detection to the source image pass. More... | |
def | predict (self) |
Generate prediction of expected measurement. More... | |
def | process (self, I) |
Apply entire predict to adapt process to source image. More... | |
def | saveTo (self, fPtr) |
Save the instantiated Detector to given HDF5 file. More... | |
Static Public Member Functions | |
def | buildFromCfg (theConfig) |
Instantiate from stored configuration file (YAML). More... | |
def | calibrate2config (theStream, outFile) |
def | load (inFile) |
Public Attributes | |
depth | |
glove | |
imGlove | |
First, perform any specified pre-processing. More... | |
imPuzzle | |
mask | |
workspace | |
Layered detector part of puzzle scene perceiver grouping.
Requires RGBD input stream.
def __init__ | ( | self, | |
detCfg = None , |
|||
detInst = None , |
|||
processors = None |
|||
) |
Constructor for layered puzzle scene detector.
[in] | detCfg | Detector configuration. |
[in] | processors | Image processors for the different layers. |
[in] | detInst | Detection instances for the different layers. |
Reimplemented in Calibrator.
def adapt | ( | self | ) |
Adapt the layer detection models.
This part is tricky as there may be dependencies across the layers in terms of what should be updated and what should not be. Applying simple filtering to establish what pixels should adapt and which ones shouldn't.
Reimplemented in Calibrator.
|
static |
Instantiate from stored configuration file (YAML).
|
static |
def correct | ( | self | ) |
Apply correction process to the individual detectors.
Apply naive correction on a per detector basis. As a layered system, there might be interdependencies that would impact the correction step. Ignoring that for now since it does not immediately come to mind what needs to be done.
Reimplemented in Calibrator.
def detect | ( | self, | |
I | |||
) |
Apply predict, measure, correct process to source image.
Running detect alone elects not to adapt or update the underlying models. The static model is presumed to be sufficient and applied to the RGBD stream.
[in] | I | Source RGB-D image (structure/dataclass). |
Reimplemented in Calibrator.
def emptyDebug | ( | self | ) |
Reimplemented in Calibrator.
def emptyState | ( | self | ) |
Get and empty state to recover its basic structure.
[out] | estate | The empty state. |
Reimplemented in Calibrator.
def getDebug | ( | self | ) |
Reimplemented in Calibrator.
def getState | ( | self | ) |
Get the complete detector state, which involves the states of the individual layer detectors.
[out] | state | The detector state for each layer, by layer. |
Reimplemented in Calibrator.
def info | ( | self | ) |
Reimplemented in Calibrator.
|
static |
def loadFrom | ( | fPtr | ) |
def measure | ( | self, | |
I | |||
) |
Apply detection to the source image pass.
[in] | I | An RGB-D image (structure/dataclass). |
Reimplemented in Calibrator.
def predict | ( | self | ) |
Generate prediction of expected measurement.
The detectors are mostly going to be static models, which means that prediction does nothing. Just in case though, the prediction methods are called for them.
Reimplemented in Calibrator.
def process | ( | self, | |
I | |||
) |
Apply entire predict to adapt process to source image.
[in] | I | Source RGB-D image (structure/dataclass). |
Reimplemented in Calibrator.
def saveTo | ( | self, | |
fPtr | |||
) |
Save the instantiated Detector to given HDF5 file.
The save process saves the necessary information to re-instantiate a Detectors class object.
[in] | fPtr | An HDF5 file point. |
Reimplemented in Calibrator.
depth |
glove |
imGlove |
First, perform any specified pre-processing.
Second, invoke the layer detectors and post-processor to differentiate the actual semantic layers of the scene. The layer detectors should be considered as raw detectors that need further polishing to extract the desired semantic layer information. These layers are further processed by customized track pointers and filters. The post processing here is hard-coded rather than a private member function invocation.
Shrink region associated to the surface just to clean up potential sources of confusion and promote recovery of puzzle pieces that are fully captured. Package the processed layers started with the glove. Next, remove any parts of the not surface layer that intersect with the expanded glove region. May remove adjacent puzzle piece area; that's OK since we can't rely on those pieces having been fully measured/captured. After that
imPuzzle |
mask |
workspace |